To note. The correct updated dataset is here: https://huggingface.co/datasets/common-pile/caselaw_access_project
Enrico Shippole
conceptofmind
AI & ML interests
None yet
Recent Activity
updated a dataset 1 day ago
TeraflopAI/beir-minus-nanobeir-random-nested-subsets updated a dataset 5 days ago
TeraflopAI/beir-minus-nanobeir-random-nested-subsets-embeddings-pca published a dataset 5 days ago
TeraflopAI/beir-minus-nanobeir-random-nested-subsets-embeddings-pcaOrganizations
repliedto their post 8 months ago
repliedto their post 8 months ago
Hi Jay,
We did not use AI. I hand wrote a custom parser to manually correct many of the errors we saw.
Thank you,
Enrico
posted an update about 2 years ago
Post
3701
Teraflop AI is excited to help support the Caselaw Access Project and Harvard Library Innovation Lab, in the release of over 6.6 million state and federal court decisions published throughout U.S. history. It is important to democratize fair access to data to the public, legal community, and researchers. This is a processed and cleaned version of the original CAP data.
During the digitization of these texts, there were erroneous OCR errors that occurred. We worked to post-process each of the texts for model training to fix encoding, normalization, repetition, redundancy, parsing, and formatting.
Teraflop AI’s data engine allows for the massively parallel processing of web-scale datasets into cleaned text form.
Link to the processed dataset: https://huggingface.co/datasets/TeraflopAI/Caselaw_Access_Project
The Caselaw Access Project dataset is licensed under the CC0 License.
We plan to release trillions of commercially licensed text tokens, images, audio, videos, and other datasets spanning numerous domains and modalities over the next months. If you are interested in contributing commercially licensed data be sure to reach out: https://twitter.com/EnricoShippole
Follow us for the next collaborative dataset releases: https://twitter.com/TeraflopAI
During the digitization of these texts, there were erroneous OCR errors that occurred. We worked to post-process each of the texts for model training to fix encoding, normalization, repetition, redundancy, parsing, and formatting.
Teraflop AI’s data engine allows for the massively parallel processing of web-scale datasets into cleaned text form.
Link to the processed dataset: https://huggingface.co/datasets/TeraflopAI/Caselaw_Access_Project
The Caselaw Access Project dataset is licensed under the CC0 License.
We plan to release trillions of commercially licensed text tokens, images, audio, videos, and other datasets spanning numerous domains and modalities over the next months. If you are interested in contributing commercially licensed data be sure to reach out: https://twitter.com/EnricoShippole
Follow us for the next collaborative dataset releases: https://twitter.com/TeraflopAI
- 3 replies