ArchiveHub Setup, Background & Research Based on IA Data
Technical details and schematics of the ArchiveHub crawler setup:
Nguyen, H. & Weber, M. S. (2015). Internet Archives as a Tool for Research: Decay in Large Scale Archival Records. Proceedings of the IEEE Big Data Congress.
Weber, M. S., Nguyen, H. (2015). Big Data? Big Issues: Degradation in Longitudinal Data and Implications for Social Sciences. WebSci 2015 Proceedings.
Weber, M. S. (2014). Observing the Web by Understanding the Past: Archival Internet Research. WWW'14 Companion Proceedings. doi: 10.1145/2567948.2579213
Examples of research based on Internet Archive data:
Weber, M. S. & Monge, P. (in press). Industries in turmoil: Driving transformation during periods of disruption. Communication Research. doi: 10.1177/0093650213514601