Automated cronjobs in BRAINCoGS (Developer Guide)
- There are some processes that are triggered automatically in BRAINCoGS.
- All these processes are handled by u19proc virtual machine administered by PNI Help. Contact Garrett T. McGrath gmcgrath@princeton.edu for permissions to it.
- All processes are handled by u19prod user account so it's not linked to any personal account.
List of automate processes in BRAINCoGS
- Behavior, Manipulation, Optogenetics, Pupillometry tables ingestion
- Alert system daily routine
- Ephys/Imaging Automation Pipeline process
Behavior, Manipulation, Optogenetics, Pupillometry tables ingestion (MATLAB Cronjob)
- Execution schedule: daily at 4:00 am
- Location in u19proc: /home/u19prod@pu.win.princeton.edu/Datajoint_projs/U19-pipeline-matlab/scripts/call_u19_night_cronjob.sh
- Overview: Call populate_tables.m script. Ingest all Behavior related tables from acquision.SessionStarted & acquisition.Session new records from that day. Check the populate_tables.m script for more information
Alert system daily routine
- Execution schedule: daily at 3:00 am
- Location in u19proc: /home/u19prod@pu.win.princeton.edu/Datajoint_projs/U19-pipeline_python/u19_pipeline/alert_system/call_cronjob_alert.sh
- Overview: Call cronjob_alert.py script .
- Read Alert System section for more information.
Ephys/Imaging Automation Pipeline process
- Called when: at every 30th minute.
- Location in u19proc: /home/u19prod@pu.win.princeton.edu/Datajoint_projs/U19-pipeline_python/u19_pipeline/automatic_job/call_cronjob_automatic_job.sh
- Overview: Call cronjob_automatic_job.py (Ephys Imaging cronjob script) . Check if a new recording has been added from RecordingProcessJobGUI or a job (recording process) has advanced to a new status. If any of these have occurred the "next" function or process is called for the recording and/or job.
Pupillometry Pipeline Queue process
- Called when: at every 20th minute.
- Location in u19proc: /home/u19prod@pu.win.princeton.edu/Datajoint_projs/U19-pipeline_python/u19_pipeline/automatic_job/call_pupillometry_queue_jobs.sh
- Overview: Call pupillometry handler check_pupillometry_sessions_queue . Queue new job to
spockvm2
for pupillometry session.
Pupillometry Pipeline Check process
- Called when: daily at 2:00 am
- Location in u19proc: /home/u19prod@pu.win.princeton.edu/Datajoint_projs/U19-pipeline_python/u19_pipeline/automatic_job/call_pupillometry_check_jobs.sh
- Overview: Call pupillometry handler check_processed_pupillometry_sessions . Check if job in
spockvm2
for pupillometry has finished and retrieve data to ingest in pupillometry_session_model_data
table.