Skip to content
This repository was archived by the owner on Nov 7, 2019. It is now read-only.
This repository was archived by the owner on Nov 7, 2019. It is now read-only.

Custom Crawls Chapter #19

@jeffreyliu

Description

@jeffreyliu

Create a chapter introducing custom crawls on Data Together

Sections:

  1. What is custom crawling?
  • Why do some websites need custom crawls?
  • What should your custom crawler extract from the webpage?
  • Examples of sites needing custom crawlers
  1. Introduction/tutorial for Morph
  • What is morph?
  • Make a Morph acct
  • Getting a Data Together API key, and making sure morph can access it
  1. Tutorial for Archivertools package
  • What does it do?
  • Installing package
  • Using Archiver class
  1. Examples/case studies of custom crawls

cc @ebenp

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions