Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding support for graphdb #174

Draft
wants to merge 13 commits into
base: dev
Choose a base branch
from
Draft

Adding support for graphdb #174

wants to merge 13 commits into from

Conversation

Mzack9999
Copy link
Member

@Mzack9999 Mzack9999 commented Nov 13, 2022 •
edited

Description

This PR adds the following functionalities:

Example

go run . -u "http://192.168.1.1" -v -c 1 -og test.dot

image

@Mzack9999 Mzack9999 added the Type: Enhancement Most issues will probably ask for additions or changes. label Nov 13, 2022
@Mzack9999 Mzack9999 self-assigned this Nov 13, 2022
@Mzack9999 Mzack9999 marked this pull request as draft November 13, 2022 17:16
@Mzack9999 Mzack9999 linked an issue Nov 13, 2022 that may be closed by this pull request
Create storage crawling graph implementation for headless crawler #13
Open
@Mzack9999
Copy link
Member Author

  • In headless mode feature extraction consider raw page (http://xxx) and post-dom-rendered page ((http://xxx/) as two different node states
  • Graph needs to be prettified
  • The graph needs a storage layer
  • Graph should support diff comparison
  • Extensive tests coverage of similarity + feat. extraction

@Mzack9999 Mzack9999 closed this Nov 16, 2022
@Mzack9999 Mzack9999 reopened this Nov 16, 2022
@Mzack9999 Mzack9999 mentioned this pull request Feb 1, 2023
Closed
@ehsandeep ehsandeep added the Status: In Progress This issue is being worked on, and has someone assigned. label Jun 27, 2023
@Mzack9999 Mzack9999 mentioned this pull request Mar 19, 2024
Closed
Base automatically changed from dev to main March 26, 2024 08:48
@ehsandeep ehsandeep changed the base branch from main to dev March 26, 2024 12:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@Mzack9999 Mzack9999

Labels
Status: In Progress This issue is being worked on, and has someone assigned. Type: Enhancement Most issues will probably ask for additions or changes.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Create storage crawling graph implementation for headless crawler
2 participants
@Mzack9999 @ehsandeep