Difference between revisions of "TextAnalysis"
Jump to navigation
Jump to search
| Line 40: | Line 40: | ||
==Miscellaneous text analysis tools== | ==Miscellaneous text analysis tools== | ||
* [http://voyant-tools.org/ Voyant Tools], a simple web-based analysis and visualization tool | * [http://voyant-tools.org/ Voyant Tools], a simple web-based analysis and visualization tool | ||
| − | * [http://lexos.wheatoncollege.edu/upload Lexos], a tool | + | * [http://lexos.wheatoncollege.edu/upload Lexos], a tool that allows the user to scrub, chunk, and tokenize text, as well as to perform modest analysis |
* [http://www.laurenceanthony.net/software/antconc/ Laurence Anthony's AntConc], a GUI concordancing and text analysis toolkit | * [http://www.laurenceanthony.net/software/antconc/ Laurence Anthony's AntConc], a GUI concordancing and text analysis toolkit | ||
* [https://sites.google.com/site/casualconc/ CasualConc], a Mac OSX-native toolkit (AntConc's Mac version is ported from the PC, and has some bugs) | * [https://sites.google.com/site/casualconc/ CasualConc], a Mac OSX-native toolkit (AntConc's Mac version is ported from the PC, and has some bugs) | ||
| Line 48: | Line 48: | ||
** [http://dclure.org/logs/tuning-textplot/ Blog post explicating TextPlot's parameters] | ** [http://dclure.org/logs/tuning-textplot/ Blog post explicating TextPlot's parameters] | ||
* [http://bookworm.culturomics.org/ Bookworm], a customizable trend visualization tool | * [http://bookworm.culturomics.org/ Bookworm], a customizable trend visualization tool | ||
| + | * [https://www.jasondavies.com/wordtree/ Word Tree], a tool that creates [http://betterevaluation.org/evaluation-options/wordtree word trees] from a block of text | ||
=Corpus building= | =Corpus building= | ||
Revision as of 13:51, 2 March 2016
Resources for Exploring Text Analysis
- "Where to Start," courtesy of Ted Underwood
- Stanford's Introduction, from Tooling Up for Digital Humanities
- Brendan O’Connor, et al., "Computational Text Analysis for Social Science"
- Paul Baker, Using Corpora in Discourse Analysis (soon to be available in the NEU Library stacks); covers Corpus Building, Frequency and Dispersion, Concordance, and Collocation
- seeking suggestions for a web-based resource
Python
- Folgert Karsdorp, Python Programming for the Humanities
- Charles Severance, Python for Informatics, an applied but comprehensive introductory Python text with sections on text parsing
- Download and install Python
- Download and install PyCharm, an Integrated Development Environment (IDE) for Python
R
- Matthew Jockers, Text Analysis With R for Students of Literature (PDF available for download via the NEU Library)
- Download and install R
- Download and install RStudio, an Integrated Development Environment (IDE) for R
- RSeek, a search tool for finding resources on R
- Simple data types in R
Topic Modeling
- Megan R. Brett's "Basic Introduction" (conceptual)
- Scott Weingart's "Guided Tour" (comprehensive, lots of links)
- Ted Underwood, "Topic modeling made just simple enough" (interpreting the results)
- Ben Schmidt's article about Latent Dirichlet allocation's (LDA's) limitations
Tools
- MALLET, an open-source and Java-based Latent Dirichlet allocation (LDA) package
- Ben Schmidt's R package wrapping MALLET
- GUI Tools that use MALLET
- Stanford Topic Modeling Toolbox (an alternative to MALLET)
word2vec
- Ben Schmidt's Blog Post on Vector Space Models
- which links to his R package wrapping word2vec (word2vec is written in C)
Miscellaneous text analysis tools
- Voyant Tools, a simple web-based analysis and visualization tool
- Lexos, a tool that allows the user to scrub, chunk, and tokenize text, as well as to perform modest analysis
- Laurence Anthony's AntConc, a GUI concordancing and text analysis toolkit
- CasualConc, a Mac OSX-native toolkit (AntConc's Mac version is ported from the PC, and has some bugs)
- David McClure's TextPlot, a Python package that produces force-directed network of words in a text, the nodes of which are clustered using estimated kernel densities
- Bookworm, a customizable trend visualization tool
- Word Tree, a tool that creates word trees from a block of text
Corpus building
Some places to get texts
Plain text
- Project Gutenberg
- Early English Books Online (EEBO) (some texts TEI-encoded)
- Early Caribbean Digital Archive (ECDA)