Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Summer #115

Merged
merged 75 commits into from
Sep 1, 2022
Merged
Changes from 1 commit
Commits
Show all changes
75 commits
Select commit Hold shift + click to select a range
f763249
Really it's a gmail sender
robertdstein Jul 31, 2022
a63415a
Add base watchdog
robertdstein Jul 31, 2022
a96e2ed
Actually send summary by email
robertdstein Jul 31, 2022
1033266
Default to last night
robertdstein Jul 31, 2022
0726c30
Add option for email attachment
robertdstein Aug 2, 2022
6589d4f
Log to file
robertdstein Aug 2, 2022
812f192
Fix typo in summary
robertdstein Aug 2, 2022
d80e10e
Go for local time, giving symmetry with log
robertdstein Aug 2, 2022
f2a04e1
Watchdog logs with time
robertdstein Aug 2, 2022
ce22aa6
Set log in watchdog
robertdstein Aug 2, 2022
6b570ea
Change email defaults
robertdstein Aug 2, 2022
c95476b
Add watchdog fields
robertdstein Aug 2, 2022
20054ad
Option for watchdog from main
robertdstein Aug 2, 2022
281c434
Avoid watchdog name conflict with more... colourful... 'Scrutineer'
robertdstein Aug 2, 2022
54be9de
Remove concept of self.processors entirely, clearing path to multi-pr…
robertdstein Aug 2, 2022
c01116f
Add monitor, redo cache/hash so cache names are based on hashes of th…
robertdstein Aug 3, 2022
9bf0c41
Require load_raw_image again for pipeline
robertdstein Aug 3, 2022
2cc79ae
Catch duplicate uids for postgres
robertdstein Aug 4, 2022
1853fd8
Catch duplicate uids for postgres
robertdstein Aug 4, 2022
0dad181
Deverboseify postgres logging
robertdstein Aug 4, 2022
0886ee7
No output to terminal
robertdstein Aug 4, 2022
92f5333
Move ImageNotFoundError.
robertdstein Aug 4, 2022
e8e353a
Raise ImageNotFoundError for batch
robertdstein Aug 4, 2022
661017c
Properly filter out summer biases, flats (and darks, apparently)
robertdstein Aug 4, 2022
73da41f
Catch all errors
robertdstein Aug 4, 2022
e6109f8
Require watchdog:
robertdstein Aug 4, 2022
df50c5f
Add CalHunter
robertdstein Aug 4, 2022
32630b1
Use CalHunter for summer
robertdstein Aug 4, 2022
5367032
Move cal requirement to cal hunter
robertdstein Aug 4, 2022
1d99d42
Update import
robertdstein Aug 4, 2022
1d95673
Wrapper out cal finding function for recycling in Monitor
robertdstein Aug 4, 2022
954c6ea
add option for default calibrations, used by monitor
robertdstein Aug 4, 2022
899420d
actually use load_image for calhunter
robertdstein Aug 5, 2022
216e189
New parsing error
robertdstein Aug 5, 2022
a5b2e1d
Handle directory creation, fix errorstack instantiation
robertdstein Aug 5, 2022
9d8cb1d
Skip but log non-critical errors
robertdstein Aug 5, 2022
cf92457
Deactivate y raw input
robertdstein Aug 29, 2022
1f6286d
More check for weird filters
robertdstein Aug 30, 2022
a522503
Integrate emails with working monitor
robertdstein Aug 30, 2022
9f7e740
Less hardcoded cal requirements
robertdstein Aug 30, 2022
79c68c7
Can't send email after monitor stops
robertdstein Aug 30, 2022
70cf1af
u can do it via main...
robertdstein Aug 30, 2022
e6a2a67
Properly parse all options for monitor
robertdstein Aug 30, 2022
dafdc5e
Write full error stack to separate file
robertdstein Aug 30, 2022
180177b
Count images processed and failed
robertdstein Aug 30, 2022
9d485e9
Recycle standard reduction for realtime, fix #111
robertdstein Aug 30, 2022
4b93a85
Add extra line at end of email
robertdstein Aug 30, 2022
8a2961d
Use integers to count errors, not floats
robertdstein Aug 30, 2022
d8eae34
Write error file even for no errors
robertdstein Aug 30, 2022
8287c6b
Don't reinvent wheel on error file writing
robertdstein Aug 30, 2022
8c0632a
Default to last night for offline, tonight for monitor
robertdstein Aug 30, 2022
13e1c18
Pep-compliant removal of raw 'Except:' clause
robertdstein Aug 30, 2022
3edd7e7
Remove redundant file
robertdstein Aug 30, 2022
aa7805e
Spinoff load_raw_summer_image
robertdstein Aug 30, 2022
3f2a75b
Spinoff load_raw_summer_image
robertdstein Aug 30, 2022
3028627
Spin off generators to different script
robertdstein Aug 30, 2022
dcc7f40
Spin off generators to different script
robertdstein Aug 30, 2022
34fb582
Remove duplicated files
robertdstein Aug 31, 2022
f9f4562
Shared psfex config
robertdstein Aug 31, 2022
8ea4976
De-hardcode imsub test
robertdstein Aug 31, 2022
73b66e9
Don't save test reduction images
robertdstein Aug 31, 2022
da4edd2
Reorgainse pipeline into blocks
robertdstein Aug 31, 2022
297ddfc
Split up imsub into three pieces
robertdstein Aug 31, 2022
e699687
Reorganise to put processor blocks in blocks, and recycle for tests
robertdstein Aug 31, 2022
58ac554
Add constants.py
robertdstein Aug 31, 2022
31aa9e1
Fix summer test
robertdstein Aug 31, 2022
a76603b
Merge pull request #113 from winter-telescope/summer
robertdstein Aug 31, 2022
5997348
Merge branch 'emails' of github.com:winter-telescope/winterdrp into e…
virajkaram Aug 31, 2022
e3efdfd
Option to specify raw sub dir
robertdstein Aug 31, 2022
8dc48c7
Use local time for date
robertdstein Aug 31, 2022
6b008f7
Be more clever with subdirectories for cal hunter
robertdstein Aug 31, 2022
9805152
Add in export to raw database for summer
virajkaram Aug 31, 2022
634ab02
Continually update error log with each error, rather than only at the…
virajkaram Aug 31, 2022
442e724
CSV log into load images block
virajkaram Aug 31, 2022
0e5fba0
Check that fits files are correct length, otherwise wait a bit
virajkaram Sep 1, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Go for local time, giving symmetry with log
  • Loading branch information
robertdstein committed Aug 30, 2022

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
commit d80e10e8c2b6f27630d6c508a25e9e216c198c0d
6 changes: 3 additions & 3 deletions winterdrp/errors/__init__.py
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
from winterdrp.paths import base_name_key
import traceback
from astropy.time import Time
from datetime import datetime
import logging
import numpy as np

@@ -30,7 +30,7 @@ def __init__(
self.error = error
self.processor_name = processor_name
self.contents = contents
self.t_error = Time.now()
self.t_error = datetime.now()
self.known_error_bool = isinstance(self.error, BaseProcessorError)

def message_known_error(self) -> str:
@@ -43,7 +43,7 @@ def generate_log_message(self) -> str:


def generate_full_traceback(self) -> str:
msg = f"Error for processor {self.processor_name} at time {self.t_error} UT: \n " \
msg = f"Error for processor {self.processor_name} at {self.t_error} (local time): \n " \
f"{''.join(traceback.format_tb(self.error.__traceback__))}" \
f"{type(self.error).__name__}: {self.error} \n " \
f"This error affected the following files: {self.contents} \n" \