vidscraper

UNKNOWN

Project description

Vidscraper is a library for retrieving information about videos from various sources – video feeds, APIs, page scrapes – combining it, and presenting it in a unified manner, all as efficiently as possible.

Vidscraper comes with built-in support for popular video sites like blip, vimeo, ustream, and youtube, as well support for generic RSS feeds with feedparser.

Quick example

>>> import vidscraper
>>> video = vidscraper.auto_scrape('http://www.youtube.com/watch?v=PMpu8jH1LE8')
>>> video.title
u"The Magic Roundabout - Ermintrude's Folly"
>>> video.description
u"Ermintrude's been at the poppies again, but it's Dougal who ends up high as a kite!"
>>> video.user
u'nickhirst999'
>>> video.guid
'http://gdata.youtube.com/feeds/api/videos/PMpu8jH1LE8'

Command line

vidscraper also comes with a command line utility allowing you to get video metadata from the command line. The example above could look like this:

$ vidscraper video http://www.youtube.com/watch?v=PMpu8jH1LE8 \
  --fields=title,description,user,guid
Scraping http://www.youtube.com/watch?v=PMpu8jH1LE8...
{
  "description": "Ermintrude's been at the poppies again, but it's Dougal who ends up high as a kite!",
  "fields": [
    "title",
    "description",
    "user",
    "guid"
  ],
  "guid": "http://gdata.youtube.com/feeds/api/videos/PMpu8jH1LE8",
  "title": "The Magic Roundabout - Ermintrude's Folly",
  "url": "http://www.youtube.com/watch?v=PMpu8jH1LE8",
  "user": "nickhirst999"
}

Project links

code:: https://github.com/pculture/vidscraper/
docs:: http://vidscraper.readthedocs.org/
bugtracker:: http://bugzilla.pculture.org/
code:: https://github.com/pculture/vidscraper/
irc:: #vidscraper on irc.freenode.net
build status:

Requirements

Python 2.6+
BeautifulSoup 4.0.2+
feedparser 5.1.2+
python-requests 0.13.0+ (But less than 1.0.0!)

Optional

requests-oauth 0.4.1+ (for some APIs *cough* Vimeo searching *cough* which require authentication)
lxml 2.3.4+ (recommended for BeautifulSoup; assumed parser for test results.)
unittest2 0.5.1+ (for tests)
mock 0.8.0+ (for tests)
tox 1.4.2+ (for tests)

Project details

Release history Release notifications | RSS feed

This version

1.0.2

Jan 24, 2013

1.0.1

Dec 27, 2012

1.0.0

Aug 10, 2012

0.5.3

Jan 3, 2013

0.5.2

May 31, 2012

0.5.1

Apr 3, 2012

0.5

Mar 31, 2012

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

vidscraper-1.0.2.tar.gz (250.7 kB view details)

Uploaded Jan 24, 2013 Source

File details

Details for the file vidscraper-1.0.2.tar.gz.

File metadata

Download URL: vidscraper-1.0.2.tar.gz
Upload date: Jan 24, 2013
Size: 250.7 kB
Tags: Source
Uploaded using Trusted Publishing? No

File hashes

Hashes for vidscraper-1.0.2.tar.gz
Algorithm	Hash digest
SHA256	`8c3b7046650271afd4ac2b39f222f5c262ec10ac08902c324a56c1825137e2f4`
MD5	`b81c3d0cec92a3392acea24a484c159a`
BLAKE2b-256	`402462c69e4de9707b2bdf80ddeceabee988c7b2113763284139e87a4e710b25`