qananasikq
|
1453eee83b
|
update sync
|
2026-04-24 18:00:09 +03:00 |
|
qananasikq
|
fc1bea562a
|
fast parser
|
2026-04-24 12:39:05 +03:00 |
|
qananasikq
|
d5d6ba8b7c
|
fix scraper flow
|
2026-04-22 21:40:40 +03:00 |
|
qananasikq
|
133c125e9c
|
fix: eliminate greenlet crash + memory leak protection
- docker-compose: switch worker to --pool=solo --concurrency=1 --max-tasks-per-child=1
- tasks.py: remove ThreadPoolExecutor wrapper from _run_browser_job (greenlet crash)
- scraper.py: browser fallback runs sequentially instead of ThreadPoolExecutor
- scraper.py: add gc.collect() after scraper close to prevent memory leaks
|
2026-04-20 17:33:51 +03:00 |
|
qananasikq
|
5999c2e42d
|
checkpoint: pipeline + 27k/h baseline before sitemap discovery
|
2026-04-18 16:34:09 +03:00 |
|
qananasikq
|
6165c65159
|
add segmented listing sync
|
2026-04-15 21:57:40 +03:00 |
|
qananasikq
|
0add3913eb
|
fix listing parsing
|
2026-04-14 19:31:57 +03:00 |
|
qananasikq
|
6a334d3c64
|
tune docker config
|
2026-04-14 14:03:26 +03:00 |
|
qananasikq
|
a4c93a1df1
|
fix docker scraping
improve batch sync
add postgres upsert
fix sync locking
improve listing sync
speed up scraper
clean up project
prepare for github
update docker setup
|
2026-04-13 16:35:08 +03:00 |
|
qananasikq
|
85b4ff8502
|
remove xvfb, use headless with cookie auth
|
2026-04-10 20:01:53 +03:00 |
|
qananasikq
|
2cbefbde93
|
update local run setup
|
2026-04-10 19:47:20 +03:00 |
|
qananasikq
|
18dab6d48d
|
docker non-root and healthcheck fix
|
2026-04-10 15:18:57 +03:00 |
|
qananasikq
|
eb9fb48ea0
|
improve docker compose setup
|
2026-04-09 20:34:34 +03:00 |
|
qananasikq
|
e5700f9623
|
postgres redis docker compose setup
|
2026-04-08 22:54:51 +03:00 |
|
qananasikq
|
b2d3902bcc
|
stabilize daemon sync and docker startup
|
2026-04-08 14:30:44 +03:00 |
|
qananasikq
|
78b52b265f
|
IAAI scraper
|
2026-04-07 23:51:41 +03:00 |
|