Waiting for User Title Language Retification Project - Part One

[Xnot]

MangaDex supports the ability to give each series multiple titles/alt-titles. At some point, we also added the ability to mark which language each alt-title is in. The problem is that we had no data for every title added before that point and they were marked as english, which is not very cool.

I did what anyone would do and ran all titles in the database through a unicode character script classifier, then mapped each script to a list of languages that use it and labeled every title with the list of languages it is likely to belong to based on the % of characters in each script. There are many language which use the Latin script so this method is kinda trash for that (we'll possibly get back to that on part two), but I believe we can fix a significant portion of titles in other scripts with this. I've filtered all titles whose current language does not match its script and put it on a google doc so that people can verify it and contribute to the effort. If you've verified/edited a set of titles, comment the row numbers here and I will periodically update the doc.

 

[OisE]

• 00034238-6f5d-4f98-a51c-69afb21d920f Issue, 2 entries in the sheet, too many titles, no english title,

but the main story's title is : " I'm Doomed if It Can't Be You"

• 0003d7e8-31da-463b-97e9-e87045f8f5ee Correct
• 0005f648-47c8-41f9-9473-444d65d17885 Edited => however don't know if 好天气汪午饭！is japanese or chinese
• 000983fe-d3c1-4e66-aecf-bd207d1afa09 Edited
• 000a5410-11d4-41c6-92fb-c5b57396c741 Edited

• 00104b69-0f96-41e0-ab40-7ae9b7ccc920 Edited => however don't know if 天医無縫 is japanese or chinese
• 0011545f-6560-481e-a53a-972690fb3695 Edited
• 0012ec97-7e85-42ab-9bbe-1e474102e7fd Edited
• 00135d3d-06a2-41a7-aec9-e949f9536b00 Correct, 2 entries in the sheet
• 00148825-e802-456c-8cfd-e10ab05d58c6 Correct

• 00170e66-713c-40ed-aa75-8c029cdcc3d9 Edited
• 00171d76-68e9-4135-8c2b-d645deebeb82 Edited
• 001a2289-ad1a-4544-b1d8-3465dbb14a86 Edited, no english title
• 001a9ee6-f601-4fee-bcdb-8baa4bc26981 Edited, no english title
• 001bc08b-21a9-47fa-bfc0-82b0ad77a58b Edited, no english title

Idk if it is want you want. I hope it helps a little.

 

[OisE]

I have a question :

Do we need to write just one time the title without the language tag or we need to rewrite it with the alternative titles ?

An example :

https://imgur.com/ViKr91D

https://imgur.com/WpXI8vK

Here the english title is not in the alternative titles list. Is it not needed to mark it as an english title ?

 

[OisE]

• 001c5f74-c18f-4ab5-9cd6-a46455932934 Correct
• 001f1dae-a245-4125-9ee3-f8e80c634990 Edited
• 00251b0a-d30f-4433-b20c-33eb76449f92 Edited, 3 entries
• 00263852-827f-42ca-9264-612c3fb18ee6 Edited
• 0026cc9e-8150-4494-ba8d-50887726d974 Correct

• 002835a6-c7e5-4ec2-a907-dbe32117b104 Edited, don't know if it's a french or english title
• 00293f4b-8ccc-4f65-95ef-b1a0c32d5ac8 Edited
• 002a8f9e-b2e1-4841-8745-bd3d66f252e6 Edited
• 003097c2-c8ee-4eda-908f-7c427f417245 Correct
• 003216b4-9081-48f4-a6b1-7b1ee35e2ae3 Edited

• 003849a4-e249-4399-a199-34786b8ff91f Correct
• 00385e82-13b4-437c-b808-ee00a7d42249 Edited, 2 entries
• 003a8935-fb27-495f-82de-17203c2aeb27 Edited
• 003b5f82-1f80-4775-bef2-d5c5bc81f3c9 Edited
• 003c3b4a-82bc-4922-997a-7e46b7321e50 Correct

• 00455c19-73d5-463e-bae4-73f110ea879c Edited, no english title
• 0045625f-03d8-468b-ad30-de33cbb927fc Edited, 2 entries
• 0046506d-6805-4476-879c-5b398a84ac68 Correct, 2 entries
• 00471031-ac96-4a4a-b24b-d2826221c789 Correct
• 00491925-22b1-4663-b9bb-fe46e242e645 Edited, don't know if 摩子 is chinese or japanese

 

[OisE]

• 004e1a57-8271-4336-83f3-3777ef52a57c Edited
• 004e6dbe-b8cf-4f95-8ab2-e5f112ead297 Edited
• 004f244e-03d0-4ee0-ba0e-d2d2f8e6cdbf Edited
• 005051e7-5e35-472f-b266-d3a37ce61ea6 Correct, no english title, 3 entries
• 005143c6-d844-4e51-bd68-625cd66242c1 Correct

• 0051e50a-e30c-4bb2-b378-c3da82463ee1 Correct, 3 entries
• 0054ee53-da9a-496e-bbff-e5945c72db12 Edited
• 0056e7a5-33fc-4aa3-97e1-6a74170c7f50 Edited, but idk the translation is weird "Junjou Cider" english or japanese ?

純情ドッロプ => Dorropu not cider ??!

• 00575427-0dcd-4905-b764-16f3aea8bfe4 Edited, no english title, 2 entries
• 005b434a-f5ba-49cc-8a97-549ae4a386c6 Edited, 4 different titles in japanese

• 005b7e3c-2927-45ae-87db-bb3aa04c65e0 Correct
• 005bd017-e839-49f4-bda2-5796491e2e6f Edited
• 005bf9d0-afcf-4fd6-b422-3c4393ef8c23 Correct, don't know if 食糧人類 is japanese or traditional chinese, 3 entries
• 005ff962-889d-4614-82b1-630ff97e846e Edited, no english title
• 0060d8ec-a17c-4273-b430-83233ce0818e Edited

 

[Xnot]

I have a question :

Do we need to write just one time the title without the language tag or we need to rewrite it with the alternative titles ?

An example :

https://imgur.com/ViKr91D

https://imgur.com/WpXI8vK

Here the english title is not in the alternative titles list. Is it not needed to mark it as an english title ?

If it's already in the main title, there's no need to repeat it on the alt titles.

Thanks for the contributions, I have edited the doc to filter out the verified entries.

 

[OisE]

• 0009a4c7-76dc-49c4-b39d-9899b9f2e995 can't access => this ? b6641b6c-eb13-448b-b296-1be4912b4cc8 Correct
• 00282b73-4699-409e-93ef-613c7dcd19ab can't access => this ? 21d0046a-4646-4e7b-92e3-ab783f4b0ff8 Correct, no english title
• 00611a4e-0c11-4e88-8a26-eb459cc0270e Edited, 2 entries
• 0061c5ed-c160-4d37-8ff1-ecc28a54d3cc Edited
• 0064ebff-4cbf-444f-bb0d-fbc824d1e370 Edited

• 00686876-f413-49a5-a39e-8bd905d53c12 Correct, 2 entries
• 0069e28a-e51a-4548-bde7-c675df1b6617 Edited
• 006d2e07-55a5-4c61-9bb2-940e625cf90d Edited
• 00706f18-3dd0-4fef-bec1-c3a0a500c943 Correct
• 0070851b-c8ac-4751-964a-4bb13d821f9c Correct, no english title

• 00710da8-d320-42e5-a76d-fa0fae6017cc Edited
• 00719812-4db7-4a62-bd47-f91c7b2fb86c Edited, 9 entries
• 007250a2-6dec-4349-bf54-61c62581a779 Correct, 3 entries
• 007c16b6-f30d-444e-b8c9-96bd8417192f Edited
• 007e8be7-7686-483e-9044-4aa2c85fe11e Edited

• 007ececa-e5d1-471d-9f16-a21a73481164 Edited, 2 entries
• 0082d63a-1b63-4d5b-8fc4-67c7a34ab773 Edited, no english titles but it's a doujinshi
• 00861d20-cb93-48d3-8130-9a9a46660ffc Correct, 2 entries
• 0088dcd4-5ec7-4071-8d3d-8356ff85753b Edited, 2 entries
• 00893d86-c910-4247-b5cb-a2a0e0380012 Correct, 5 entries

• 008c1aec-fbd9-41b6-ac9f-34cc44c04700 Edited
• 00904334-01f1-4174-a81e-9170c9f54b97 Edited
• 0097cb30-1bef-4e58-8937-fe401c9f4dfa Edited
• 009801e9-09fe-4b69-834d-9a6fc832fe36 Edited
• 009917c4-ae35-4cee-b83e-47ba28f1bbcd Edited

• 009a2f1f-666e-43f2-b424-782daf5a00c8 Edited
• 009bd26f-23b2-4f6e-9ed9-ba49391c49e8 Edited
• 009de2f1-7b18-4f5f-8d3e-330e158d0798 Correct
• 00a28555-7446-45a4-a8e5-3df049328f37 Edited
• 00a2a2fe-c93d-4950-9ed4-9ebdd84b1fdd Edited

• 00a3a20d-adbd-402c-a7fc-8d672ee2d3a0 Edited, 3 entries
• 00a52d8a-5148-4198-b2bb-cd8ce619519e Edited
• 00a82fcc-997d-4139-9d2c-8935628199c5 Edited, 4 entries
• 00a9a2ba-89a8-479d-9848-97361faaf3c3 Edited
• 00af0a04-1535-4f25-85b6-7d1b119dc48d Edited

 

[OisE]

• 00b5305f-7770-4338-8e61-9871e57e3193 Correct, no english title
• 00b64b8f-cb7e-4322-9855-3669fe210ac7 Correct
• 00b82a54-2faf-44d7-a5a2-2ac80e516851 Edited, not sure but for me Mahou Shoujo Madoka Magica is english title
• 00b8a2ad-b0eb-40bd-a6dc-4f52a8f0e1e0 Edited
• 00bda9c9-f057-4e0e-9b3a-875489529a4d Edited

• 00c184ee-2e8c-4ec6-b16d-18651ecb7361 Correct
• 00c2d96d-24e6-41a1-b4cb-18df05da0383 Edited
• 00c6fa3a-b8fa-4120-a5ba-5fef268228f5 Edited
• 00c76090-a70f-4d96-a663-00c2e088ba16 Edited, 3 entries
• 00cbf0db-2caa-4995-9bf5-570b6ff78eef Edited, 3 entries, no en title, is Аса-чан! Kyrgyz ?, there is no Kyrgyz tag !!

• 00cfd73c-fbb4-4afd-b793-773402d02a2c Edited
• 00d107df-b3ec-4ffb-bc4c-064f0653cc43 Edited, I don't understand this entry there was just a main title...
• 00d22884-a479-40e6-a8c4-47b3f8f630dc Edited, chinese but there is no chinese title ..?
• 00d27570-3fa0-415b-9eec-f4b04c353795 Edited, 2 entries
• 00d4e032-67a1-4a6b-84de-e698da2667f3 Edited

• 00d632f2-526a-4ecd-9f1d-1e53cbc7bfdb Edited
• 00da3ad0-bd2d-4cc2-850c-4e61561cd176 Edited
• 00dd8a7d-635b-4206-97f4-d42ae3992389 Edited
• 00e07ecc-5afe-45c2-807e-bbcdea4e161b Edited, need Icelandic, Slovenian and Kyrgyz tags
• 00e51ba5-08d4-45de-ada1-3e090cc43dd4 Correct

 

[Xnot]

I don't understand this entry there was just a main title...

I included both main titles and alt titles in the doc since main titles also have a language attribute, though I now realize the front-end does not have support for editing the lang on those. Keep mentioning them and I'll edit them through the mod tools.

 

[OisE]

I now realize the front-end does not have support for editing the lang on those

Ooooooh. I need to review all the main titles to make sure...wait I can't review the language tag.

 

[Xnot]

you can check them in the API but I don't really expect people to do that so let's ignore that for now

 

[OisE]

• 00e73ebd-d806-4dd3-ba57-379785ca403d Edited
• 00e896e3-d038-445a-b81e-42ae91351344 Edited
• 00e9b9b9-7c2a-4347-8b03-cebfa6f366a9 Edited
• 00eab497-5360-4a3f-b616-093c79b809c4 Edited
• 00eb5a40-9d63-44b1-9227-d0718ea8a795 Correct

• 00ef45d1-301e-4e52-932b-3a570d91932c Edited
• 00f126f5-e2a6-4588-a147-b5ba035f355e Edited
• 00f5732b-8af2-4c5a-b2bb-e42bd8b25be5 Edited
• 00f9a938-2f38-44b8-896b-aea6ce49da2c Edited
• 00faf1ea-5086-4d75-9621-5a597e523e21 Edited

 

[OisE]

• 00fc664e-edfd-42e8-b117-28300e2b1517 Edited
• 00ffe1b6-b9e9-453d-8164-921ce9b91cc2 Correct
• 01032477-8a98-4240-9b34-f480772d3c5c Correct
• 01049e59-a670-4c69-97bb-0e2d5f612e14 Correct
• 0106bbe9-6783-4ea9-89a1-3a0333a0a6c5 Edited

• 01075765-3503-4d0a-a08e-f733a56cced6 Edited
• 010932f2-3a76-43f1-bc83-ecb126a17a1c Edited
• 010a2252-bdc9-4cd4-bbcd-603cc9c3c6b2 Edited
• 010a4fda-4e13-48bd-be3f-8d6ac4dcdbcd Correct
• 010c4077-14d2-48b8-ae1c-c30851b74ff7 Edited

• 010d7f0d-c095-406f-ab2b-03ed8a5d2125 Cannot edit and it's false, all en...
• 010db7f3-385a-467c-afdc-1223989d23f3 Edited
• 010f39bd-d73f-44f4-a6d0-b1e0202a986a Edited
• 010f70a7-5239-4b2a-a84f-903187f58cac Edited
• 0110603c-92ec-463e-8d13-7651211e492e Correct

• 4d9f4cf6-6162-4167-ac13-0688295eb526 Edited
• 0111ec91-d174-43e1-9395-2dceb80ac68b Correct
• 01170729-06db-4c63-85da-39de276d78b7 Edited
• 01189446-6b03-4212-8ce3-3a7e2a1b6d59 Edited
• 01194baf-f5c3-4258-9639-3f6b9c1b6678 Correct

• 011a0e55-4e70-4280-8544-5426101e6ad8 Edited
• 011a1ddc-8b09-44d1-ac5d-ab11226e6c49 Correct
• 011add68-d61a-49b6-8c6f-d8d4aca153a9 Edited
• 011b52e3-4389-4f32-a7e1-1e799078fad2 Edited
• 0123dd7a-8fb9-4004-a001-787598f93d38 Correct

 

[OisE]

• 0005f648-47c8-41f9-9473-444d65d17885 Edited
• 00104b69-0f96-41e0-ab40-7ae9b7ccc920 Edited
• 002835a6-c7e5-4ec2-a907-dbe32117b104 Edited
• 00491925-22b1-4663-b9bb-fe46e242e645 Edited
• 005bf9d0-afcf-4fd6-b422-3c4393ef8c23 Edited

• 00cbf0db-2caa-4995-9bf5-570b6ff78eef Edited
• 010af929-bfe1-4f57-8069-af3969e0dd57 no title.. and the code bugged my response => I can't delete the text (edit worked) Might be this title : c0a21db3-cf5d-49ad-af89-0d794566d4da Correct
• 0123e7fc-a69f-480f-8b1c-c6e6e4136b15 Correct
• 0124bab3-12ac-4239-bc8d-0ed2902d25fa Correct
• 0125e2e3-3b0f-483f-9c4f-66975e2fd417 Edited

• 0126f354-22b3-460c-98a3-f9b8d7b01369 Edited
• 0127fdc7-ea80-4108-acd9-c1ff2c431d2f Correct
• 0129cd56-8bf6-4237-aab1-b1b599a151d9 Edited
• 012b944b-9a62-46ad-8830-18fcb0a7a8cd Edited
• 012c7f69-cb95-4ecc-bf59-a4986a4dc35a Edited

• 012e8a2a-6a01-4733-9fde-ba1926d5b7fb Correct
• 012eb8dd-7e06-4f58-b88a-c47a5afe1477 Edited
• 0132e2d4-d62d-4d75-b375-b2a90ae7ffa6 Edited
• 01332624-d343-47d3-ba96-e077b71bef1f Edited
• 0139cf88-bb86-41ac-8c6c-00244b19f4cf Edited

 

[OisE]

216 -> 246 are all good now.

id 223 (in the google sheet) :
01432726-c13b-4f6f-a53d-98e911faec6a
no title with at this url, maybe this one ?

id 242 : 015d7710-3924-465a-b302-6731773e9ed2 Uzbek language required

I think it's easier to do it like this for me, if it's no good for you I can change.

 

[OisE]

Btw, I have a little suggestion :

Maybe you can code something like this.

If you have :

• Counter({'KATAKANA': 1.., AND/OR 'HIRAGANA': 1.., AND/OR 'KATAKANA-HIRAGANA': 1..* AND 'LATIN': 1..*}) => Japanese
• Counter({'KATAKANA': 1.., AND/OR 'HIRAGANA': 1.., AND/OR 'KATAKANA-HIRAGANA': 1..*}) => It's Japanese
• Counter({'HANGUL': 1..* }) => It's Korean
• Counter({'HANGUL': 1..* AND 'LATIN': 1..*}) => It's Korean
• Counter({'KATAKANA': 1..* AND/OR 'HIRAGANA': 1..* AND/OR 'KATAKANA-HIRAGANA': 1..* AND 'HANGUL': 1..*}) => ERROR

I think it can help a lot with the work.

 

[Xnot]

Btw, I have a little suggestion :

Maybe you can code something like this.

If you have :

• Counter({'KATAKANA': 1.., AND/OR 'HIRAGANA': 1.., AND/OR 'KATAKANA-HIRAGANA': 1..* AND 'LATIN': 1..*}) => Japanese
• Counter({'KATAKANA': 1.., AND/OR 'HIRAGANA': 1.., AND/OR 'KATAKANA-HIRAGANA': 1..*}) => It's Japanese
• Counter({'HANGUL': 1..* }) => It's Korean
• Counter({'HANGUL': 1..* AND 'LATIN': 1..*}) => It's Korean
• Counter({'KATAKANA': 1..* AND/OR 'HIRAGANA': 1..* AND/OR 'KATAKANA-HIRAGANA': 1..* AND 'HANGUL': 1..*}) => ERROR

I think it can help a lot with the work.

Yeah I guess I could count all the japanese scripts together for example to try and make it more accurate. I'd also like to re-run an updated version to get rid of some of the titles which have already been changed in the meantime and maybe make this more digestable, but for now I've gotta wait until database access is available again.

 

[OisE]

Any update?

I think you can correct a lot of errors.

Also, it would be good to separate the titles who don't have a title in their original language.

 

[Xnot]

No change on this front for now unfortunately.

 

[hoffingtonleigh]

Let's get this started up again.
12235 is locked.

Alt title	Japanese
Publication date	2016
Demographic	none

Forgot something: The MAL link is wrong. The correct one is https://myanimelist.net/manga/113710/BanG_Dream_Yonkoma__Bandori

How is this format? I think it's good for locked entries, especially for those that need additional fixing.


Another one

7958 + romanized japanese
A really weird entry. This is some kind of BG version and there is a YG version? Besides that I could only find out it's been serialized in Big Gangan. Maybe Lymus knows something, he's the only uploader.

And another one

36074

And another one

3687 + japanese I'd say. The "x" from the cover can be written as x, X, × etc. except for when you want to be exact. Then it should be ×, the for whatever reason quiet, i.e. unspoken japanese cross symbol. Or what the stores use.

The updated editing timeframe is ridiculous compared to the measly minutes we had before.

And another one

19938 + romanized japanese

And another one

48165-48167

And another one

The main title of https://mangadex.org/title/b775a6cc-3f91-46da-ba69-41018004b14e is romanized japanese