Datasets for Data Mining and Data Science

https://github.com/mattbane/RecommenderSystem

http://grouplens.org/datasets/movielens/

KDDCUP-2012官网

From kdnuggets

Data repositories

AWS (Amazon Web Services) Public Data Sets, provides a centralized repository of public data sets that can be seamlessly integrated into AWS cloud-based applications.

BigML big list of public data sources.

Bioassay data, described in Virtual screening of bioassay data, by Amanda Schierz, J. of Cheminformatics, with 21 Bioassay datasets (Active / Inactive compounds) available for download.

Bitly 1.usa.gov data, anonymized clicks on gov links.

Canada Open Data, pilot project with many government and geospatial datasets.

Causality Workbench data repository.

Corral Big Data repository at Texas Advanced Computing Center, supporting data-centric science.

Data Source Handbook, A Guide to Public Data, by Pete Warden, O'Reilly (Jan 2011).

Datacatalogs.org, open government data from US, EU, Canada, CKAN, and more.

Data.gov.uk, publicly available data from UK (also London datastore.)

Data.gov/Education, central guide for education data resources including high-value data sets, data visualization tools, resources for the classroom, applications created from open data and more.

DataMarket, visualize the world's economy, societies, nature, and industries, with 100 million time series from UN, World Bank, Eurostat and other important data providers.

Datamob, public data put to good use.

DataSF.org, a clearinghouse of datasets available from the City & County of San Francisco, CA.

DataFerrett, a data mining tool that accesses and manipulates TheDataWeb, a collection of many on-line US Government datasets.

Delve, Data for Evaluating Learning in Valid Experiments

EconData, thousands of economic time series, produced by a number of US Government agencies.

Enron Email Dataset, data from about 150 users, mostly senior management of Enron.

Europeana Data, contains open metadata on 20 million texts, images, videos and sounds gathered by Europeana - the trusted and comprehensive resource for European cultural heritage content.

FEDSTATS, a comprehensive source of US statistics and more

FIMI repository for frequent itemset mining, implementations and datasets.

Financial Data Finder at OSU, a large catalog of financial data sets.

GDELT: The Global Data on Events, Location and Tone, described by Guardian as "a big data history of life, the universe and everything."

GEO (GEO Gene Expression Omnibus), a gene expression/molecular abundance repository supporting MIAME compliant data submissions, and a curated, online resource for gene expression data browsing, query and retrieval.

GeoDa Center, geographical and spatial data.

Google ngrams datasets, text from millions of books scanned by Google.

Grain Market Research, financial data including stocks, futures, etc.

Hilary Mason research-quality Big Data sets collection - many text and image datasets.

HitCompanies Datasets, comprehensive data on random 10,000 UK companies sampled from HitCompanies, updated automatically using AI/Machine Learning.

ICWSM-2009 dataset contains 44 million blog posts made between August 1st and October 1st, 2008.

Infochimps, an open catalog and marketplace for data. You can share, sell, curate, and download data about anything and everything.

Investor Links, includes financial data

KDD Cup center, with all data, tasks, and results.

Kevin Chai list of datasets, for text, SNA, and other fields.

KONECT, the Koblenz Network Collection, with large network datasets of all types in order to perform research in the area of network mining.

Linking Open Data project, at making data freely available to everyone.

Million Song Dataset

MIT Cancer Genomics gene expression datasets and publications, from MIT Whitehead Center for Genome Research.

ML Data, the data repository of the EU Pascal2 networks.

NASDAQ Data Store, provides access to market data.

National Government Statistical Web Sites, data, reports, statistical yearbooks, press releases, and more from about 70 web sites, including countries from Africa, Europe, Asia, and Latin America.

National Space Science Data Center (NSSDC), NASA data sets from planetary exploration, space and solar physics, life sciences, astrophysics, and more.

NetworkRepository: Interactive Data Repository, has many collections of graph and networks from social science, machine learning, scientific computing, and other areas.

Open Data Census, assesses the state of open data around the world.

OpenData from Socrata, access to over 10,000 datasets including business, education, government, and fun.

Open Source Sports, many sports databases, including Baseball, Football, Basketball, and Hockey.

Peter Skomoroch dataset Bookmarks

PubGene(TM) Gene Database and Tools, genomic-related publications database

Quandl, a collaboratively curated portal to millions of financial and economic time-series datasets.

qunb, a platform to find and visualize quantitative data.

Robert Schiller data on housing, stock market, and more from his bookIrrational Exuberance.

SMD: Stanford Microarray Database, stores raw and normalized data from microarray experiments.

Jerry Smith dataset collection, with Finance, Government, Machine Learning, Science, and other data.

SourceForge.net Research Data, includes historic and status statistics on approximately 100,000 projects and over 1 million registered users' activities at the project management web site.

StatLib, CMU Datasets Archive.

STATOO Datasets part 1 and STATOO Datasets part 2

Time Series Data Library

Visual Analytics Benchmark Repository.

UCI KDD Database Repository for large datasets used in machine learning and knowledge discovery research.

UCI Machine Learning Repository.

UCR Time Series Data Archive, offering datasets, papers, links, and code.

United States Census Bureau.

Wikiposit, a (virtual) amalgamation of (mostly financial) data from many different sites, allowing users to merge data from different sources

Wolfram Alpha disease and patient level data.

Yahoo Sandbox datasets, Language, Graph, Ratings, Advertising and Marketing, Competition

Yelp Academic Dataset, all the data and reviews of the 250 closest businesses for 30 universities for students and academics to explore and research.

Related

Data Mining Competitions

KDD Cup results summary