e-space
Manchester Metropolitan University's Research Repository

    Linguistic features evaluation for hadith authenticity through automatic machine learning

    Mohamed, Emad and Sarwar, Raheem ORCID logoORCID: https://orcid.org/0000-0002-0640-807X (2022) Linguistic features evaluation for hadith authenticity through automatic machine learning. Digital Scholarship in the Humanities, 37 (3). pp. 830-843. ISSN 2055-7671

    [img]
    Preview
    Accepted Version
    Available under License In Copyright.

    Download (417kB) | Preview

    Abstract

    There has not been any research that provides an evaluation of the linguistic features extracted from the matn (text) of a Hadith. Moreover, none of the fairly large corpora are publicly available as a benchmark corpus for Hadith authenticity, and there is a need to build a 'gold standard' corpus for good practices in Hadith authentication. We write a scraper in Python programming language and collect a corpus of 3,651 authentic prophetic traditions and 3,593 fake ones. We process the corpora with morphological segmentation and perform extensive experimental studies using a variety of machine learning algorithms, mainly through automatic machine learning, to distinguish between these two categories. With a feature set including words, morphological segments, characters, top N words, top N segments, function words, and several vocabulary richness features, we analyze the results in terms of both prediction and interpretability to explain which features are more characteristic of each class. Many experiments have produced good results and the highest accuracy (i.e. 78.28%) is achieved using word n-grams as features using the Multinomial Naive Bayes classifier. Our extensive experimental studies conclude that, at least for Digital Humanities, feature engineering may still be desirable due to the high interpretability of the features. The corpus and software (scripts) will be made publicly available to other researchers in an effort to promote progress and replicability.

    Impact and Reach

    Statistics

    Activity Overview
    6 month trend
    52Downloads
    6 month trend
    23Hits

    Additional statistics for this dataset are available via IRStats2.

    Altmetric

    Repository staff only

    Edit record Edit record