TextDetox Multilingual Toxicity — Hindglish

A TextDetox 2024 shared task (Hindglish) dataset of 4,363 Hindglish posts (2,200 toxic, 2,163 non-toxic), collected by Dementieva et al. for PAN/CLEF TextDetox 2024. Each record contains post text, binary toxicity label (0=non-toxic, 1=toxic). TextDetox Hindglish provides 4,363 balanced binary toxicity annotations — part of a 15-language multilingual benchmark for cross-lingual toxicity detection research. Suitable for toxicity detection, multilingual content moderation, cross-lingual NLP, hate speech classification, text detoxification.

#Code mixing#Detoxification#Hinglish#Pan clef#Textdetox

Download data BibTeX JSONSimilar datasets

Analytics

Content metrics

4,363 records scored

is toxic50.4% true
true 50.4%false 49.6%
6.0
Flesch–Kincaid grade
US school grade level
7.1
Automated readability index
Frequent terms
hainahibhiaurkyakarmodinhiअपनkoideshbhaihainbjpaapkuchrahalogliyerahethatumindiaकरनsabparbaattohapnechahiyeआपकhumhogakiyaapniसकतagardiyahotajobkarokisiyehmaiसरकkamtakकरकlogosir
Topic clusters

Topic 0

bjp
evm
party
jai
aap
जस
vote
ho

Topic 1

रह
और
नह
रत
कर
बन
जनत
करन

Topic 2

bhai
movie
dekh
video
ab
film
viral
gaya

Topic 3

ko
ki
hai
se
desh
hain
nahi
aur

Topic 4

ndtv
videos
सरक
पढ
खबर
गए
पर
एक

Topic 5

hai
nahi
ye
ki
ka
ko
kar
sakta

Topic 6

sat
ka
veer
yar
thik
jai
naman
andar

Topic 7

modi
modiji
ji
pm
raaj
rh
rajnath
ka

Topic 8

56
inch
60
modi
sina
ka
10
saal

Topic 9

army
india
indian
pak
express
ha
thi
maa

Topic 10

modi
bjp
hai
ke
ko
vote
mcd
bhi

Topic 11

हम
नह
रह
और
जव
पर
कर
सरक
Show all 43 topics

Topic 12

india
kashmir
hay
tum
fuji
ne
mar
kr

Topic 13

aur
hai
ki
koi
dharm
ko
ye
bhi

Topic 14

nahi
ke
bhi
ko
desh
ka
hai
chahiye

Topic 15

maaro
bolega
kutta
aisa
tu
aadmi
ni
ek

Topic 16

party
congress
bjp
hai
se
ko
election
nhi

Topic 17

नह
अपन
जब
सप
एग
जर
रद
जनत

Topic 18

congress
jnu
chor
jayada
kahin
congres
ko
kiya

Topic 19

bike
launch
yeh
start
na
hai
mantri
rahe

Topic 20

जय
हर
पल
लडक
आपक
यण
नमन
रत

Topic 21

नर
रध
एम
नम
इव
रम
हम
रत

Topic 22

आपक
कम
पन
बस
send
15000
rs
पय

Topic 23

sahi
ha
lo
rha
hun
bilkul
sir
ji

Topic 24

elan
youtube
bus
khan
wo
aata
video
pe

Topic 25

तब
कश
हम
रह
जव
मर
शद
अलग

Topic 26

रन
ipl
बल
इव
आईप
एल
रत
कप

Topic 27

jai
mata
vande
waste
ha
saab
fail
kiya

Topic 28

randi
chiye
alg
sudhir
chal
bhagat
एल
har

Topic 29

akhilesh
kya
chala
phir
pata
agra
esse
comedian

Topic 30

chutya
fat
aayi
pasand
gandi
muje
tha
aapko

Topic 31

congress
bjp
सर
20
party
plan
walon
बदल

Topic 32

baap
lokpal
tera
gunda
thaa
aisa
karna
su

Topic 33

bache
inki
khalo
uss
gya
apna
time
mulle

Topic 34

id
करक
अपन
click
app
refer
पर
champcash

Topic 35

hindustan
han
hindu
rhega
dada
tera
hamara
hey

Topic 36

91
वश
करण
पत
love
vinod
swami
सम

Topic 37

आपन
सह
रव
हतर
बह
कह
शत
अच

Topic 38

पत
91
अनबन
मनच
टक
लव
हक
वश

Topic 39

एव
लडक
रहन
care
परव
एट
यकत
आवश

Topic 40

jai
modi
hr
ram
har
bharat
shree
mahadev

Topic 41

app
play
store
करक
id
job
उनल
अपन

Topic 42

जर
अरव
इस
कर
सकत
तर
बध
मल
Top hashtags
#म6
#र6
#breakingnews5
#प4
#cbi3
#donaldtrump3
#indvssa3
#narendramodi3
#salmankhan3
#आत3
#आप3
#द3
#न3
#स3
#ह3
#aap2
#all_problems_solution_with_in_72_hours2
#atankwad2
#azam2
#bycottindianmedia2
Top emoji
😂291
🎵60
👍53
🚩35
😀34
💐32
😁31
🇮24
🇳24
📢22
🔘21
🙏21
😜17
😡17
🏻16

Computed over the full corpus.

Record

Catalog key
textdetox-hin
Authors
Dementieva, Daryna; Moskovskiy, Daniil; Logacheva, Varvara; Dale, David; Ustalov, Dmitry; Panchenko, Alexander
Year
2024
Source paper
Overview of the Multilingual Text Detoxification Task at PAN 2024
DOI / arXiv
10.1007/978-3-031-71908-0_11
License
OpenRAIL++ (Hugging Face card) (LicenseRef-OpenRAIL-plus-plus)
Records
4,363
Languages
en, hi
Collected
2024 (2020s)
Tasks
Toxicity detection (binary; is_toxic) inferred

Provenance

Originally published at
https://huggingface.co/datasets/textdetox/multilingual_toxicity_dataset link checked
Hosted copy
Mirrored on echo.directory on 2026-10-02, 462.0 KB across 1 files. Checksums in MANIFEST.json.

Citations

Overview of PAN 2024: Multi-author Writing Style Analysis, Multilingual Text Detoxification, Oppositional Thinking Analysis, and Generative AI Authorship Verification Condensed Lab Overview
A. Ayele, N. Babakov, Janek Bevendorff, Xavier Bonet Casals, Berta Chulvi
Journal Article · Conference and Labs of the Evaluation Forum · 2024

26
citations
cited
2
influential citations
8% of all citations

Cited by

Show all 10

Citation data from Semantic Scholar, retrieved 2026-10-19.

How to cite

BibTeX

@misc{echo2026,
  title  = {ECHO: Exploratory Compendium of Humanity Online},
  author = {Switzer, Braden and Zafarani, Reza},
  year   = {2026},
  url    = {https://echo.directory},
  note   = {Syracuse University}
}

@inproceedings{dementieva2024overview,
  title     = {Overview of the Multilingual Text Detoxification Task at PAN 2024},
  author    = {Dementieva, Daryna and others},
  booktitle = {CLEF 2024 Working Notes},
  year      = {2024}
}

APA

Switzer, B., & Zafarani, R. (2026). ECHO: Exploratory Compendium of Humanity Online [Data repository]. Syracuse University. https://echo.directory

Dementieva, D., Moskovskiy, D., Logacheva, V., Dale, D., Ustalov, D., & Panchenko, A. (2024). TextDetox Multilingual Toxicity — Hindglish [Data set]. https://doi.org/10.1007/978-3-031-71908-0_11

MLA

Switzer, Braden, and Reza Zafarani. ECHO: Exploratory Compendium of Humanity Online. Syracuse University, 2026, echo.directory.

Dementieva, Daryna, et al. TextDetox Multilingual Toxicity — Hindglish. 2024, doi.org/10.1007/978-3-031-71908-0_11.

BibTeX · RIS · CSL-JSON

Similar datasets 10 all with scores →