Repository navigation
Add Lookyloo indicator lookup and capture enrichment modules - #939
Merged
Merged
Conversation
Codex Review SummaryThis comment shows the latest Codex review activity on this pull request.
ℹ️ About Codex in GitHubYour team has set up Codex to review pull requests in this repo. Reviews are triggered when you
Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Add two analyst expansion modules for existing Lookyloo captures:
lookyloo: pivot on IPv4/IPv6, domain/hostname, URL, resource SHA-512 and favicon SHA-512 using the five public occurrence APIs. Supports explicit pagination, composite MISP inputs, optional capture enrichment and deduplication.lookyloo_capture: retrieve metadata, status, redirects, IPs, hostnames, URLs, resource hashes, statistics, cached module responses and comparables from a capture link or UUID. Optional settings retrieve cookies, favicons, storage state, console messages, AI export, tree JSON, native MISP export and takedown contacts. Return links for screenshot, archive, downloaded files and video.A
lookyloo-captureobject retains provenance and links observed URL, file, image and cookie objects. Named JSON attachments retain endpoint responses and lookup metadata. The new template is proposed in MISP/misp-objects#547 and an identical copy is bundled for PyMISP versions that do not ship it yet. Install that template on the MISP server for its fields to render correctly.All new enrichment attributes use
to_ids=false; the original input retains its UUID, tags, comment and detection flag. Requests use verified TLS, optional Authorization, bounded response sizes and timeouts. Missing secondary endpoints preserve successful enrichment and add a capture error. These modules do not submit URLs, trigger external analyses, push events, send reports or call administrative endpoints. JSON documentation provides defaults, examples, endpoint coverage and exclusions; hashes use SHA-512 rather than mmh3 or MD5.Validation:
API reference: https://lookyloo.circl.lu/doc/