Commit Graph
38 Commits
Author SHA1 Message Date
owner c7fcc3297f Reduced the memory usage, as well as hopefully fixing the memory leak. Also implemented database compression across rows, including Brotli compression and bitshifting. 2025-04-05 11:28:54 +02:00
owner b0318b7759 Removed .txt 2025-02-16 09:38:57 +01:00
owner c70b42c9d7 Made a lot of changes. Enhanced memory usage. 2025-02-16 09:38:00 +01:00
owner 8d659d4261 Implement autosave 2025-02-08 13:02:18 +01:00
owner 45b6d8ecab Preparing for multithreaded content filter 2025-02-07 23:30:25 +01:00
owner 83897c72cf Way too much happened for me to create a commit message 2025-02-07 18:44:22 +01:00
owner 680b295f9e Update gitignore 2025-01-16 12:27:23 +01:00
owner 41dfb5809a Add stuff 2025-01-16 11:10:43 +01:00
owner 7abe904997 Testing search query 2025-01-05 15:37:18 +01:00
owner a6804be9f1 Implement database compression 2024-12-30 18:36:04 +01:00
owner 0cfbcea252 Testing database compression. 2024-12-24 14:23:23 +01:00
owner 53289db102 Add search page 2024-12-24 11:10:38 +01:00
owner e9fd738f1f Title and description extraction now only look in the head section of the HTML document 2024-12-23 14:09:51 +01:00
owner 580d687f62 Add user-agent 2024-12-21 21:57:01 +01:00
owner 7562bbf7d1 Add cached progress response 2024-12-19 18:36:13 +01:00
owner 97321492ba Add headers 2024-12-18 14:27:31 +01:00
owner 8628d31bec Add nuxt-purgecss to further minimize bundle size. 2024-12-18 12:02:35 +01:00
owner 8b55cf7bb6 Reworked the /progress page 2024-12-17 13:15:47 +01:00
owner 3822339dd9 Add a time-based cache for the progress result from the API 2024-12-17 10:46:10 +01:00
owner 1c74ae9de5 Added frontend and working fetching. 2024-12-14 13:26:21 +01:00
owner bab8fa6c25 Added frontend project with some basic api fetching implemented. 2024-12-06 12:33:48 +01:00
owner 5fe35192c6 Misc changes such as performance tuning, added support for more than 64 threads for the scanner. 2024-12-04 13:20:45 +01:00
owner 2cff817044 Make it so the filter does not iterate over already filtered IPs. 2024-11-29 19:13:27 +01:00
owner f2ace6f571 Reworked the queue items. 2024-11-29 12:59:07 +01:00
owner 3034e66126 Changed GET to HEAD for checking robots txt. 2024-11-29 11:02:51 +01:00
owner ec9cca59da Duscarded object is now a struct. 2024-11-28 14:36:36 +01:00
owner 3d8f903d30 Unfiltered object is now a struct. 2024-11-28 14:24:33 +01:00
owner 69a22fb3eb Fixed. 2024-11-28 10:26:44 +01:00
owner f02203c14c Fixed duplicate insertions into the filtered database. 2024-11-27 15:53:00 +01:00
owner 4eaaf0f244 Fix communication between applications. 2024-11-27 11:33:53 +01:00
owner a160992c08 Remove random sqlite file. 2024-11-26 19:44:55 +01:00
owner 1a361a9524 Create runtime variables and remove MessagePack. 2024-11-26 19:41:12 +01:00
owner be07cdb13e Create runtime variables and remove MessagePack. 2024-11-26 19:40:27 +01:00
owner 032ce539c3 Update gitignore 2024-11-25 19:21:45 +01:00
owner 9297cf4358 Remove obj folder from GIT. 2024-11-25 19:21:15 +01:00
owner 9afddf803a Remove redundant comment. 2024-11-25 19:20:08 +01:00
owner 96b5ce4ff5 Fix NetMQ not stopping. 2024-11-25 19:13:37 +01:00
owner f3c6338a6a Initial commit 2024-11-24 12:40:51 +01:00