Commit Graph

16 Commits

Author SHA1 Message Date
c7fcc3297f Reduced the memory usage, as well as hopefully fixing the memory leak. Also implemented database compression across rows, including Brotli compression and bitshifting. 2025-04-05 11:28:54 +02:00
c70b42c9d7 Made a lot of changes. Enhanced memory usage. 2025-02-16 09:38:00 +01:00
8d659d4261 Implement autosave 2025-02-08 13:02:18 +01:00
83897c72cf Way too much happened for me to create a commit message 2025-02-07 18:44:22 +01:00
a6804be9f1 Implement database compression 2024-12-30 18:36:04 +01:00
0cfbcea252 Testing database compression. 2024-12-24 14:23:23 +01:00
e9fd738f1f Title and description extraction now only look in the head section of the HTML document 2024-12-23 14:09:51 +01:00
7562bbf7d1 Add cached progress response 2024-12-19 18:36:13 +01:00
1c74ae9de5 Added frontend and working fetching. 2024-12-14 13:26:21 +01:00
5fe35192c6 Misc changes such as performance tuning, added support for more than 64 threads for the scanner. 2024-12-04 13:20:45 +01:00
2cff817044 Make it so the filter does not iterate over already filtered IPs. 2024-11-29 19:13:27 +01:00
3034e66126 Changed GET to HEAD for checking robots txt. 2024-11-29 11:02:51 +01:00
69a22fb3eb Fixed. 2024-11-28 10:26:44 +01:00
4eaaf0f244 Fix communication between applications. 2024-11-27 11:33:53 +01:00
be07cdb13e Create runtime variables and remove MessagePack. 2024-11-26 19:40:27 +01:00
f3c6338a6a Initial commit 2024-11-24 12:40:51 +01:00