Tm server to use with omegat מפרסם התגובה: Руслан И.
| Руслан И. הפדרציה הרוסית Local time: 21:14 מטורקית לרוסית + ...
I have a linux server, I want to upload my TMs to server so that I can query translation strings from omegaT. Is there such webbased software where I can store my TMs and query them. Is there an instruction to do this? Maybe there is another way to manage large TMs? | | | You can use team projects | Dec 6, 2018 |
Руслан И. wrote: I have a linux server, I want to upload my TMs to server so that I can query translation strings from omegaT. Is there such webbased software where I can store my TMs and query them. Is there an instruction to do this? Maybe there is another way to manage large TMs? Team projects work differently (they replicate the TMs locally using version control software, such as Subversion or Git), but they provide more or less the same thing. See for instance: https://www.proz.com/forum/omegat_support/240607-introduction_to_the_team_project_feature_in_omegat.html Didier | | | Руслан И. הפדרציה הרוסית Local time: 21:14 מטורקית לרוסית + ... TOPIC STARTER My main goal is different | Dec 6, 2018 |
My main goal is to upload my TMs to some web platform, so that they are stored in database. This, in my opinion, will speed up large TM lookup. | | | A database cannot be faster than memory | Dec 7, 2018 |
Руслан И. wrote: My main goal is to upload my TMs to some web platform, so that they are stored in database. This, in my opinion, will speed up large TM lookup. Of course, not having to load the TM in memory is initially faster but, for the lookup itself, a database lookup cannot be faster than searching in memory. Didier | |
|
|
Руслан И. הפדרציה הרוסית Local time: 21:14 מטורקית לרוסית + ... TOPIC STARTER TM size is a much bigger than RAM size | Dec 7, 2018 |
Didier Briel wrote: a database lookup cannot be faster than searching in memory. Yes, I agree, but total size of my TMs is much bigger than avaliable memory size on my PC. | | |
Hi Ruslan Following my answer to your previous question: as I said, actually this not possible to write a plugin for external translation memories, because OmegaT does not provide the correct API. But I also experimented the possibility to write such an API. The Lucene indexes I mentioned is only one of the possible implementations: access to a server is another potential plugin using the same API. Yo... See more Hi Ruslan Following my answer to your previous question: as I said, actually this not possible to write a plugin for external translation memories, because OmegaT does not provide the correct API. But I also experimented the possibility to write such an API. The Lucene indexes I mentioned is only one of the possible implementations: access to a server is another potential plugin using the same API. You can experiment my project Cyclotis - http://www.silvestris-lab.org/node/12 - which uses a Postgresql database for this. But actually Cyclotis is designed for very small memories in real time (i.e. for ongoing segments, so that your colleages see immediately what you are translating). The project for a bigger database, which is possible but would require some architectural changes, is mentioned in my site but is not really started now. Didier Briel wrote: Team projects work differently (they replicate the TMs locally using version control software, such as Subversion or Git), but they provide more or less the same thing. No, they do not provide the same thing as a client/server memory: Team projects are stored in a server but you have to checkout the entire project and then TMX are loaded in memory. OmegaT never does queries to a server for translation memories (only for machine translations) Didier Briel wrote: for the lookup itself, a database lookup cannot be faster than searching in memory. That is not true, because databases are usually indexed: when you do a lookup, they do not explore all the entries, which would be a linear algorithm, they look in the index itself, so the algorithm becomes logarithmic. That is how databases can be faster for any kind of search, not only for translation memories.
[Edited at 2019-01-22 07:12 GMT]
[Edited at 2019-01-22 07:13 GMT] ▲ Collapse | | | Large TM files in Team Projects can cause version control performance issues | Jul 8, 2019 |
Moving the TM data to a sever / database would also allow to avoid the performance issues caused by the large and frequently updated project TM file in a Team Project. I only have experiences with Git which already starts struggling with a 10-15MB TM file. Git is not able to efficiently and quickly compress the changes in the big TM file which makes the repository to grow quickly to hundreds of MBs or even GBs in size. Git's delta compression is not used initially in this case and w... See more Moving the TM data to a sever / database would also allow to avoid the performance issues caused by the large and frequently updated project TM file in a Team Project. I only have experiences with Git which already starts struggling with a 10-15MB TM file. Git is not able to efficiently and quickly compress the changes in the big TM file which makes the repository to grow quickly to hundreds of MBs or even GBs in size. Git's delta compression is not used initially in this case and with each commit of the project's TM the repo grows by the zlib compressed size of the TM file. Only aggressive Git garbage collection can reduce the size of these repos effectively, but it takes a lot of CPU, RAM and time to complete it successfully. Even then it is temporally and the repo starts growing quickly again. One way to workaround this would be storing the TM on a server. This way the TM's of other projects could also be made available much easier. The down site of an OmegaT TM server would be the dependency on the TM server. Currently, we can continue working locally if the network is down. ▲ Collapse | | | לא הוקצה מנהל במיוחד לפורום זה. To report site rules violations or get help, please contact site staff » Tm server to use with omegat Pastey | Your smart companion app
Pastey is an innovative desktop application that bridges the gap between human expertise and artificial intelligence. With intuitive keyboard shortcuts, Pastey transforms your source text into AI-powered draft translations.
Find out more » |
| CafeTran Espresso | You've never met a CAT tool this clever!
Translate faster & easier, using a sophisticated CAT tool built by a translator / developer.
Accept jobs from clients who use Trados, MemoQ, Wordfast & major CAT tools.
Download and start using CafeTran Espresso -- for free
Buy now! » |
|
| | | | X Sign in to your ProZ.com account... | | | | | |