PS : thanks to the message that I quoted in my previous post, I've discovered at last that you include the French translations of the sessions transcript in your website.
While looking quickly at these, I noticed a bug with the French accents — those characters : à, â, ä, é, è, ê, ë, ï, î, ô, ù, û, ü, and the same for capital letters : À, É, Ô, Ù, etc. — which are missing if sessions are accessed through the search engine.
(Special consouns ç and Ç look )
BTW, missing accents is a real problem for French : those are an integral part of written French, and the meaning can change (either a bit or a lot) depending on the accents (or their absence) ; often one can guess them, but not always.
For instance, about someone in a psychiatric hospital :
- "c'est un interne" means "(s)he's an intern(e)" (junior MD in hospital) ;
- "c'est un interné" means "he's a mental health patient" ;
...which is not the same thing (or being) at all !
So, this bug seems due to research results display (after selecting French) :
- if I access directly the session (translation), by clicking in the left menu, on a session date among the list (for instance on the last one), then I get the session with the accents.
- if I do a research (for instance on "CABM"), then I get the list of results without the accents. And if I click on one of the results, same problem : the French accents are missing.
Could you please correct this bug in the code (probably the search engine part) ?
Related request (optional) : could you add an option to the search engine, to search with or without the accents ? (Without: é, è, ê, ë and e would be the same letter. And for Spanish, ñ and n would be the same letter). In the same spirit as "case sensitive" option for other search engines.
PS : For the French special consouns ç and Ç, it looks mixed : mainly OK, sometimes not (so it's probably not the same bug, but the translation itself).
Even in the same session. For instance, session 2014-08-30 :
"(L) Ça se pourrait, ouais. Et ils arriveraient alors que les E.U. essayent de faire une fausse invasion ou une affaire sous faux drapeau. Est-ce bien de ce dont on parle ici ? Que lorsque le gouvernement de l'ouest de type consortium essaie de prendre le contrôle du monde avec leur fausse invasion, c'est à ce moment que tout va dégénérer ?
R : Plus ou moins. Vous verrez !
Q : (Pierre) Ca va être excitant, hein !?"
Hi @Bastian & all French users,
I've updated the search algorithm to be able to search for words and phrases with accented characters without removing the accented characters from the rest of the session. I've done testing on it myself and it passes--when you have a chance, could you do some testing on the search terms for the French version? I'd greatly appreciate it.
For all, you'll note that it will also highlight the spaces and other punctuation around the searched term--this is a side effect of adapting the regex to work with accented characters. However, the search functionality should be preserved and work as intended.
The optional request to normalize the search to work whether you use accents or not will have to be put on hold as I've reached a dead-end there. I'll get back on it if I ever come across a path towards a solution.
Thanks for your patience, and to @Bastian, who found this crucial bug!
Cassiopaean Session Transcripts Search
