96 Commits

Author SHA1 Message Date
fe202b56d0 fixes logging and scraper start / stop task planning 2025-06-13 13:56:46 +02:00
24f9eb5766 makes logger much more beautiful 2025-06-13 12:57:54 +02:00
4a10052eae redesign of logger frontend to streamline and unify all logger views 2025-06-13 12:30:44 +02:00
8f064cda34 adds timezone config option 2025-06-13 11:47:41 +02:00
7fd403bd40 timezone fix 2025-06-13 11:14:06 +02:00
a7964a2f3d adds scraper modules and modular publisher parser system 2025-06-13 10:11:59 +02:00
ce6bc03b46 new landing page 2025-06-11 23:54:17 +02:00
70e2e2e900 again lol 2025-06-11 23:50:29 +02:00
793f6f9a7e fix 2025-06-11 23:48:46 +02:00
8f84774880 fixes flash messages for single paper scraping 2025-06-11 23:48:38 +02:00
98901ce38e also fixes flash messages 2025-06-11 23:45:19 +02:00
d730137d20 fixes flash messages 2025-06-11 23:44:01 +02:00
e2ae95cea0 fix api path in config js 2025-06-11 23:15:25 +02:00
676a3c96eb adds pagination to scraper and improves timestamp formatting 2025-06-11 23:11:49 +02:00
7a1ab3d7e6 fixes scraper activity chart 2025-06-11 22:25:35 +02:00
a4eb7648d5 fixes scraper 2025-06-11 21:32:01 +02:00
88e180bc94 creates timeline for scraper activity 2025-06-11 14:03:35 +02:00
5c5afefe40 modularizes the templates' js 2025-06-11 11:37:09 +02:00
8ffcf4d65c fix some ui stuff 2025-06-10 19:40:28 +02:00
ceeb6c375d refactor to apscheduler instead of redis and celery 2025-06-10 19:14:59 +02:00
3b42010fab fixes scheduling 2025-06-10 11:40:36 +02:00
1e97a9cc7b refines modular scraping system. adds another dummy scraper 2025-05-26 16:13:42 +02:00
Michael Beck
ac348696b5 adds debugging tools 2025-05-24 12:39:23 +02:00
Michael Beck
3a21c4429b adds debugging scripts 2025-05-24 11:48:41 +02:00
Michael Beck
0104b04eef updates gitignore 2025-05-24 10:42:53 +02:00
Michael Beck
243e24e100 fixes quota recalculation 2025-05-23 22:22:49 +02:00
Michael Beck
74e713e8a6 adds option to set paper status when adding dummy papers 2025-05-23 21:36:41 +02:00
Michael Beck
4f0539f4b0 changes config nav to bootstrap pills 2025-05-23 21:11:40 +02:00
Michael Beck
f42be483d6 adds db config page and an option to add test papers 2025-05-23 20:03:39 +02:00
Michael Beck
36ba835980 adds cache management 2025-05-23 19:07:40 +02:00
Michael Beck
987c76969b adds path config checks in config and dummy scraper 2025-05-23 17:21:41 +02:00
Michael Beck
012163ba3f fixes dummy and single paper processing 2025-05-23 16:13:25 +02:00
Michael Beck
8f2375215d modularizes the scraper methods 2025-05-23 14:32:41 +02:00
Michael Beck
11f086aa64 implements download path configuration 2025-04-16 22:03:17 +02:00
Michael Beck
5af3d00e39 ups 2025-04-16 22:02:57 +02:00
Michael Beck
803554a410 adds shutdown commands to makefile 2025-04-16 21:41:03 +02:00
Michael Beck
4f8040e9db deletes unnecessary file 2025-04-16 21:40:34 +02:00
Michael Beck
d6c72265f9 fixes external icon links 2025-04-16 21:40:13 +02:00
Michael Beck
a0fa541de3 fixes dummy scraper 2025-04-16 21:39:59 +02:00
Michael Beck
0adaed0bfa fixes dummy paper processing 2025-04-16 16:32:52 +02:00
Michael Beck
4085b47460 adds a MAX_VOLUME variable to defaults 2025-04-16 16:09:26 +02:00
Michael Beck
14f336fadf standardizes notification in html templates 2025-04-16 15:58:42 +02:00
Michael Beck
3d67bbbdf7 standardizes notification in html templates 2025-04-16 15:58:23 +02:00
Michael Beck
592375c67b adds script block to base 2025-04-16 15:57:53 +02:00
Michael Beck
396eaefbe9 removes old scheduler 2025-04-16 15:57:44 +02:00
Michael Beck
f36fc53b26 added dummy scraper 2025-04-16 15:57:35 +02:00
Michael Beck
1f0fb5e990 fixes typo 2025-04-16 15:44:55 +02:00
Michael Beck
5d8a2bd7c4 fixes bug due to scheduling refactor 2025-04-16 15:29:06 +02:00
Michael Beck
adf8207461 redesigns config, including some placeholders 2025-04-16 15:19:28 +02:00
Michael Beck
bb2ecd842d adds upload-duplicate_strategy config in interface and backend 2025-04-16 14:06:25 +02:00