| --- |
| license: mit |
| language: |
| - yua |
| metrics: |
| - spearman rho |
| tags: |
| - maya |
| - yucatec maya |
| - embeddings |
| - low-resource languages |
| - indigenous languages |
| --- |
| |
| # maya2vec |
|
|
| maya2vec is a model to encode word embeddings in Maya. |
|
|
|  |
|
|
|
|
| maya2vec embeddings use 512 dimensions and were trained using the Skip-gram with Negative Sampling algorithm (SGNS) on data from La Jornada Maya (collaboration agreement), CENTROGEO - SEDECULTA phrases (referenced in Agreement SEDECULTA-DASJ-149-04-2024) and [T'aantsil corpus project](https://taantsil.com.mx/info). |
|
|
|
|
| ## Dependencies |
|
|
| Install gensim 4.0 version or greater. |
|
|
| ``` |
| $ pip install gensim |
| |
| |
| ``` |
|
|
|
|
| ## Usage |
|
|
| See usage.py |
|
|
| ``` |
| import gensim |
| from gensim.models import Word2Vec |
| |
| maya2vec = './model_512_60_5_-0.25_0.7308_3.35E-05' |
| |
| # load global model |
| model = Word2Vec.load(maya2vec) |
| |
| # Try out cosine similarity (dog, standing) |
| sim = model.wv.similarity("peek'", "waalak'") |
| print('''similarity("peek'", "waalak'")''', sim) |
| |
| # Similarity between 'peek'' and 'waalak'': 0.9583 |
| ``` |
|
|
| Cite the paper please: https://journal.iberamia.org/index.php/intartif/article/view/2119 |
|
|
| ``` |
| Molina-Villegas, A., et al. (2025). Generating a Culturally and Linguistically Adapted Word Similarity Benchmark for Yucatec Maya. Inteligencia Artificial, 28(76), 283–300. https://doi.org/10.4114/intartif.vol28iss76pp283-300 |
| |
| @article{maya2vec, |
| title={Generating a Culturally and Linguistically Adapted Word Similarity Benchmark for Yucatec Maya}, |
| author={Molina-Villegas, Alejandro and Suro-Villalobos, Joel and Reyes-Magaña, Jorge and Fernandez-Sabido, Silvia}, |
| journal={Inteligencia Artificial}, |
| volume={28}, |
| number={76} |
| pages={283–300}, |
| year={2025}, |
| publisher={IBERAMIA}, |
| DOI={10.4114/intartif.vol28iss76pp283-300} |
| } |
| |
| ``` |
|
|
|
|
| ## License |
|
|
| Permission is hereby granted, free of charge, to any person obtaining a copy |
| of this software and associated documentation files (the "Software"), to deal |
| in the Software without restriction, including without limitation the rights |
| to use, copy, modify, merge, publish, distribute, sublicense, and/or sell |
| copies of the Software, and to permit persons to whom the Software is |
| furnished to do so, subject to the following conditions: |
|
|
| The above copyright notice and this permission notice shall be included in all |
| copies or substantial portions of the Software. |
|
|
| THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR |
| IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, |
| FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE |
| AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER |
| LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, |
| OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE |
| SOFTWARE. |
|
|
