No description
| resources | slight reorganisation of the slides and adding some contextual material | |
| .gitignore | Initial commit | |
| exercises.md | slight reorganisation of files, added new screenshots, the dataset and updated the presentation | |
| LICENSE | Initial commit | |
| README.md | slight reorganisation of files, added new screenshots, the dataset and updated the presentation | |
| slides.html | slight reorganisation of the slides and adding some contextual material | |
| slides.md | slight reorganisation of the slides and adding some contextual material | |
| slides.pdf | slight reorganisation of files, added new screenshots, the dataset and updated the presentation | |
OpenRefine DH Lab Workshop
Overview
OpenRefine?
- Excel on steroids for working with (messy) tabular datasets
- Open-source software that runs locally, accessible through your web browser
- Not a database or web scraper, but a tool for transforming data
- Particularly good at identifying and fixing inconsistencies, or exploring your data
Key Features
- Clean and transform data
- Reconcile or extend data with external databases
- Non-destructive editing, and all operations are recorded and can be retraced/undone
- Can handle a looot of rows
- Regex and scripting support
When to Use OpenRefine
- ... exploring tabular datasets
- ... cleaning up data sheets
- ... dealing with inconsistent data formats (file format AND data structure)
- ... merging datasets from different sources
- ... preparing data for analysis in other tools
- ... standardizing names, addresses, or other text fields
- ... you need to document your data cleaning process (and re-apply it to other datasets)
Exercises and Slides
Further Resources
- OpenRefine Documentation: https://docs.openrefine.org/
- OpenRefine Recipes: https://github.com/OpenRefine/OpenRefine/wiki/Recipes
- Community Q&A: https://forum.openrefine.org/