Skip to content
This repository was archived by the owner on Nov 7, 2019. It is now read-only.
This repository was archived by the owner on Nov 7, 2019. It is now read-only.

Custom Crawls Chapter #19

@jeffreyliu

Description

@jeffreyliu

Create a chapter introducing custom crawls on Data Together

Sections:

  1. What is custom crawling?
  • Why do some websites need custom crawls?
  • What should your custom crawler extract from the webpage?
  • Examples of sites needing custom crawlers
  1. Introduction/tutorial for Morph
  • What is morph?
  • Make a Morph acct
  • Getting a Data Together API key, and making sure morph can access it
  1. Tutorial for Archivertools package
  • What does it do?
  • Installing package
  • Using Archiver class
  1. Examples/case studies of custom crawls

cc @ebenp

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions