Swan

An implementation of the Goose HTML Content / Article Extractor algorithm in golang.

Swan allows you to extract cleaned up text and HTML content from any webpage by removing all the extra junk that so many pages have these days.

Check out the go documentation page for full usage and examples.

Features

Main content extraction from almost any source
Extract HTML content with images
Get article metadata, publish dates, and a lot more
Recognize different content types and apply special extractions (currently only recognizes comic sites and normal sites)

Name		Name	Last commit message	Last commit date
Latest commit History 57 Commits
misc/git		misc/git
test_data		test_data
update		update
.travis.yml		.travis.yml
LICENSE		LICENSE
README.md		README.md
article.go		article.go
article_test.go		article_test.go
cleanup.go		cleanup.go
extract_authors.go		extract_authors.go
extract_authors_test.go		extract_authors_test.go
extract_comic.go		extract_comic.go
extract_content.go		extract_content.go
extract_content_test.go		extract_content_test.go
extract_images.go		extract_images.go
extract_images_test.go		extract_images_test.go
extract_links.go		extract_links.go
extract_links_test.go		extract_links_test.go
extract_metas.go		extract_metas.go
extract_metas_test.go		extract_metas_test.go
extract_publishdate.go		extract_publishdate.go
extract_publishdate_test.go		extract_publishdate_test.go
extract_tags.go		extract_tags.go
extract_tags_test.go		extract_tags_test.go
extract_test.go		extract_test.go
extract_title.go		extract_title.go
extract_title_test.go		extract_title_test.go
extract_top_node.go		extract_top_node.go
extract_videos.go		extract_videos.go
extract_videos_test.go		extract_videos_test.go
http.go		http.go
logo.png		logo.png
stopwords.go		stopwords.go
stopwords_list.go		stopwords_list.go
stopwords_test.go		stopwords_test.go
swan.go		swan.go
swan_test.go		swan_test.go
utf8.go		utf8.go
utf8_test.go		utf8_test.go