Releases: ail-project/lacus
Releases · ail-project/lacus
v1.11.0
Lacus changes
Full Changelog: v1.10.0...v1.11.0
- Validate capture settings with pydantic & log accordingly
- New controller to stop/restart scripts individually
- Use valkey instead of redis by default
- Bump all dependencies
LacusCore changes
Full Changelog: ail-project/LacusCore@v1.10.0...v1.11.0
- Improve DNS resolving
- Enable new chromium headless by default
- Capture favicons by default
- Improve typing, use Pydantic
PlaywrightCapture changes
Full Changelog: Lookyloo/PlaywrightCapture@v1.25.0...v1.26.0
- Use new clock API in Playwright to speedup time
- Upgrade usage of stealth module
- Accept dialogs popup by default
- Bugfixes
- Bypass many more tracking boxes
- Avoid many deadlocks
v1.10.0
v1.9.0
New feature
Optionally attempt to click on the button allowing tracking for the page we capture
One of the most dramatic example is on cnews (french equivalent of FoxNews). There is no way to show a screenshot of the capture itself, but you can go see them by clicking on the images below (the stats for the capture)
| Without tracking | With Tracking (you will need to zoom out a lot) |
|---|---|
 |
 |
This feature is a WiP as it often needs specific code to find the button to click on, but quite a few common frameworks are supported. Feel free to open an issue (or even better a pull request) in PlaywrightCapture.
Changes
- [PlaywrightCapture] Do not capture the same URL more than onde when depth is > 0
- [PlaywrightCapture] Improvements when fetching favicons
- [PlaywrightCapture] Improve timeouts
- [PlaywrightCapture] Improve logging
- [LacusCore] Speedup DNS resolution
- [LacusCore] Improve retries
For more details see release notes for LacusCore and PlaywrightCapture
Full Changelog: v1.8.0...v1.9.0
v1.8.0
What's Changed (Since 1.7.0)
- Improve monitoring
- Improve logging
- Improve handling of dead tasks
- Expose stats to API
- Strict typing
- Dump dependencies and maintenance
- Support python 3.12
- LacusCore changelog: https://github.com/ail-project/LacusCore/releases/tag/v1.8.0
- PlaywrightCapture changelog: https://github.com/Lookyloo/PlaywrightCapture/releases/tag/v1.23.0
Full Changelog: v1.7.0...v1.8.0
Hack.lu 2023
New features
- [PlaywrightCapture] Support for download triggered by JS from a rendered HTML page
- [PlaywrightCapture] Download favicons
- [LacusCore] Store capture and its children in redis hashes instead of a big key/value in redis. Avoid issue with truly big captures.
Changes
- Many improvements in timeout handling, avoid it to bee too short on capture with many children
- [LacusCore] Improve error messages
Bugfixes
- Avoid deadlocks when the context waits for the page to be closed (and the page is stuck)
- Avoid dangling temp files when downloading didn't work.
Pass The Salt 2023
New features
- Support for HTTP credentials, viewport, geolocation, timezone locale and color scheme in the capture settings
- Global proxy settings
- Daily statistics (visible in the monitoring)
Changes
- Store the capture results in a compressed pickle instead of JSON, reduces the RAM use by a lot
- Improve documentation, option in the update script to only install and not start the system
Bugfixes
- Very annoying crash when the headers were improperly set causing the captures to fail
- Many bugfixes and improvments in PlaywrightCapture and LacusCore
Spring cleanup
This release is the outcome of a whole lot of changes in the last few months across PlaywrightCapture and LacusCore.
New features
- [Lacus] Use new async mechanism from LacusCore, improves long running processes
- [Lacus] Allow to stop the capturing process cleanly, do not kill ongoing captures until they're done or we reach a timeout
Changes
- [PlaywrightCapture] Major improvement in exceptions handling and reporting
- [PlaywrightCapture] Major improvements in logging mechanism, mostly avoiding logging irrelevant things, or flagging as warning unimportant things
- [PlaywrightCapture] Properly bubble up to LacusCore a suggestion to retry the capture
- [PlaywrightCapture] Improve handling of timeout for captures taking too long, log that fact
- [PlaywrightCapture] Use more recent version of Playwright
- [PlaywrightCapture] Sanitize HTTP headers
- [PlaywrightCapture] Much better handling of exceptions raised by the browsers, avoid waiting until we reach the timeout if the capture already failed
- [LacusCore] Major improvements when using async
- [LacusCore] Major improvement in exceptions handling and reporting
- [LacusCore] Major improvements in logging mechanism, mostly avoiding logging irrelevant things, or flagging as warning unimportant things
- [LacusCore] Properly handle hints from PlaywrightCapture regarding retries
- [LacusCore] Improve handling of timeouts, and raising more if something gets stuck
- [Lacus] Improve handling of dead processes, cleanup
- [Lacus] Improve tracking of ongoing captures
- [Lacus] Improve logging
Bugfixes
- [PlaywrightCapture] Do not keep HTTP headers (especially broken ones) in the session for subsequent captures
- [LacusCore] Properly handle hints from PlaywrightCapture regarding retries
Late february release
There were very few changes in Lacus itself. Most of the changes happened in LacusCore and PlaywrightCapture.
HoHoHoliday season release
Breaking change
Poetry v1.3.0 or more recent is now required, please upgrade to the latest version.
New Features
- Always enable reCAPTCHA bypass (doesn't always work, but we do what we can)
- Script to stop capture_manager cleanly (waits for the ongoing captures to finish before stopping)
Bugfixes
- Better exceptions handling in Lacus, LacusCore and PlaywrightCapture
- [LacusCore] Block captures of files on disk unless authorized
- [PlaywrightCapture] Improve timeout handling
- [PlaywrightCapture] Improve reCAPTCHA solving
Changes
- Update Flask and flask-restx, all other dependencies.
- [PlaywrightCapture] Update Playwright, adapt capture script accordingly
- [LacusCore] Optionally submit a capture with a pre-defined UUID
- Major logging improvements in Lacus, LacusCore and PlaywrightCapture
Late october cleanup
New features
- Allow to cleanly kill the capture process independently from the other:
pkill -15 capture_manager - Add runtime for the captures (logs and response)