{"id":983,"date":"2024-09-26T12:16:31","date_gmt":"2024-09-26T10:16:31","guid":{"rendered":"https:\/\/digitalmerit.eu\/merithon\/?post_type=m2challenge&p=983"},"modified":"2024-10-31T10:41:42","modified_gmt":"2024-10-31T08:41:42","slug":"the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement","status":"publish","type":"m2challenge","link":"https:\/\/digitalmerit.eu\/merithon\/m2challenge\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\/","title":{"rendered":"Challenge #04: The usage of artificial intelligence-based methods for text data quality improvement"},"content":{"rendered":"\n

The dataset quality is very important to the correct model development. At the same time, it requires a high scale of human resources to label the data. Text-based dataset (corpus) development task is even more complicated. Human labelling in text dataset cases is very affected by individual interpretations. The usage of multiple experts to label at the same time becomes too complicated when huge datasets are owned. All this requires some methods or solutions, which could help in text-based dataset quality estimation or improvement, indicating suspicious labelling records.<\/p>\n\n\n\n

The direction for the challenge ideas, which could be converted into multiple final thesis or individual project topics is the following:<\/p>\n\n\n\n

    \n
  1. The outlier and noise points detection in textual data analysis.<\/li>\n\n\n\n
  2. The automatic class adjustment for the labelled text data.<\/li>\n\n\n\n
  3. The research on the efficiency of large language models for multi-label text data quality improvement.<\/li>\n\n\n\n
  4. The product review evaluation adjustment based on natural language processing and statistics methods.<\/li>\n<\/ol>\n\n\n\n

    Regarding more details on the challenge and topics contact Pavel Stefanovi\u010d, VILNIUS TECH.<\/p>\n","protected":false},"excerpt":{"rendered":"

    Develope methods or solutions, which could help in text-based dataset quality estimation or improvement, indicating suspicious labelling records<\/p>\n","protected":false},"featured_media":984,"template":"","class_list":["post-983","m2challenge","type-m2challenge","status-publish","has-post-thumbnail","hentry"],"yoast_head":"\nChallenge #04: The usage of artificial intelligence-based methods for text data quality improvement - MERIThON<\/title>\n<meta name=\"description\" content=\"Improvement of a text-based dataset quality by apply different artificial intelligence methods and human in the loop concept\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/digitalmerit.eu\/merithon\/m2challenge\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Challenge #04: The usage of artificial intelligence-based methods for text data quality improvement - MERIThON\" \/>\n<meta property=\"og:description\" content=\"Improvement of a text-based dataset quality by apply different artificial intelligence methods and human in the loop concept\" \/>\n<meta property=\"og:url\" content=\"https:\/\/digitalmerit.eu\/merithon\/m2challenge\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\/\" \/>\n<meta property=\"og:site_name\" content=\"MERIThON\" \/>\n<meta property=\"article:modified_time\" content=\"2024-10-31T08:41:42+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/digitalmerit.eu\/merithon\/wp-content\/uploads\/2024\/09\/corpus.png\" \/>\n\t<meta property=\"og:image:width\" content=\"640\" \/>\n\t<meta property=\"og:image:height\" content=\"640\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@digitalmeriteu\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/m2challenge\\\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\\\/\",\"url\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/m2challenge\\\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\\\/\",\"name\":\"Challenge #04: The usage of artificial intelligence-based methods for text data quality improvement - MERIThON\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/m2challenge\\\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/m2challenge\\\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/wp-content\\\/uploads\\\/2024\\\/09\\\/corpus.png\",\"datePublished\":\"2024-09-26T10:16:31+00:00\",\"dateModified\":\"2024-10-31T08:41:42+00:00\",\"description\":\"Improvement of a text-based dataset quality by apply different artificial intelligence methods and human in the loop concept\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/m2challenge\\\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/m2challenge\\\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/m2challenge\\\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\\\/#primaryimage\",\"url\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/wp-content\\\/uploads\\\/2024\\\/09\\\/corpus.png\",\"contentUrl\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/wp-content\\\/uploads\\\/2024\\\/09\\\/corpus.png\",\"width\":1024,\"height\":1024,\"caption\":\"corpus\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/m2challenge\\\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Challenge #04: The usage of artificial intelligence-based methods for text data quality improvement\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/#website\",\"url\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/\",\"name\":\"MERIThon\",\"description\":\"Upskill yourself with MERIT!\",\"publisher\":{\"@id\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/#organization\",\"name\":\"MERIThon\",\"url\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/wp-content\\\/uploads\\\/2024\\\/02\\\/merithon_logo.png\",\"contentUrl\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/wp-content\\\/uploads\\\/2024\\\/02\\\/merithon_logo.png\",\"width\":661,\"height\":472,\"caption\":\"MERIThon\"},\"image\":{\"@id\":\"https:\\\/\\\/digitalmerit.eu\\\/merithon\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/x.com\\\/digitalmeriteu\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/digital-merit\",\"https:\\\/\\\/www.instagram.com\\\/digitalmeriteu\",\"https:\\\/\\\/www.youtube.com\\\/channel\\\/UCZCZhMSWZfsX74bsnGhcM8g\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Challenge #04: The usage of artificial intelligence-based methods for text data quality improvement - MERIThON","description":"Improvement of a text-based dataset quality by apply different artificial intelligence methods and human in the loop concept","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/digitalmerit.eu\/merithon\/m2challenge\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\/","og_locale":"en_US","og_type":"article","og_title":"Challenge #04: The usage of artificial intelligence-based methods for text data quality improvement - MERIThON","og_description":"Improvement of a text-based dataset quality by apply different artificial intelligence methods and human in the loop concept","og_url":"https:\/\/digitalmerit.eu\/merithon\/m2challenge\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\/","og_site_name":"MERIThON","article_modified_time":"2024-10-31T08:41:42+00:00","og_image":[{"url":"https:\/\/digitalmerit.eu\/merithon\/wp-content\/uploads\/2024\/09\/corpus.png","width":640,"height":640,"type":"image\/png"}],"twitter_card":"summary_large_image","twitter_site":"@digitalmeriteu","twitter_misc":{"Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/digitalmerit.eu\/merithon\/m2challenge\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\/","url":"https:\/\/digitalmerit.eu\/merithon\/m2challenge\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\/","name":"Challenge #04: The usage of artificial intelligence-based methods for text data quality improvement - MERIThON","isPartOf":{"@id":"https:\/\/digitalmerit.eu\/merithon\/#website"},"primaryImageOfPage":{"@id":"https:\/\/digitalmerit.eu\/merithon\/m2challenge\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\/#primaryimage"},"image":{"@id":"https:\/\/digitalmerit.eu\/merithon\/m2challenge\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\/#primaryimage"},"thumbnailUrl":"https:\/\/digitalmerit.eu\/merithon\/wp-content\/uploads\/2024\/09\/corpus.png","datePublished":"2024-09-26T10:16:31+00:00","dateModified":"2024-10-31T08:41:42+00:00","description":"Improvement of a text-based dataset quality by apply different artificial intelligence methods and human in the loop concept","breadcrumb":{"@id":"https:\/\/digitalmerit.eu\/merithon\/m2challenge\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/digitalmerit.eu\/merithon\/m2challenge\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/digitalmerit.eu\/merithon\/m2challenge\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\/#primaryimage","url":"https:\/\/digitalmerit.eu\/merithon\/wp-content\/uploads\/2024\/09\/corpus.png","contentUrl":"https:\/\/digitalmerit.eu\/merithon\/wp-content\/uploads\/2024\/09\/corpus.png","width":1024,"height":1024,"caption":"corpus"},{"@type":"BreadcrumbList","@id":"https:\/\/digitalmerit.eu\/merithon\/m2challenge\/the-usage-of-artificial-intelligence-based-methods-for-text-data-quality-improvement\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/digitalmerit.eu\/merithon\/"},{"@type":"ListItem","position":2,"name":"Challenge #04: The usage of artificial intelligence-based methods for text data quality improvement"}]},{"@type":"WebSite","@id":"https:\/\/digitalmerit.eu\/merithon\/#website","url":"https:\/\/digitalmerit.eu\/merithon\/","name":"MERIThon","description":"Upskill yourself with MERIT!","publisher":{"@id":"https:\/\/digitalmerit.eu\/merithon\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/digitalmerit.eu\/merithon\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/digitalmerit.eu\/merithon\/#organization","name":"MERIThon","url":"https:\/\/digitalmerit.eu\/merithon\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/digitalmerit.eu\/merithon\/#\/schema\/logo\/image\/","url":"https:\/\/digitalmerit.eu\/merithon\/wp-content\/uploads\/2024\/02\/merithon_logo.png","contentUrl":"https:\/\/digitalmerit.eu\/merithon\/wp-content\/uploads\/2024\/02\/merithon_logo.png","width":661,"height":472,"caption":"MERIThon"},"image":{"@id":"https:\/\/digitalmerit.eu\/merithon\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/digitalmeriteu","https:\/\/www.linkedin.com\/company\/digital-merit","https:\/\/www.instagram.com\/digitalmeriteu","https:\/\/www.youtube.com\/channel\/UCZCZhMSWZfsX74bsnGhcM8g"]}]}},"_links":{"self":[{"href":"https:\/\/digitalmerit.eu\/merithon\/wp-json\/wp\/v2\/m2challenge\/983","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/digitalmerit.eu\/merithon\/wp-json\/wp\/v2\/m2challenge"}],"about":[{"href":"https:\/\/digitalmerit.eu\/merithon\/wp-json\/wp\/v2\/types\/m2challenge"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/digitalmerit.eu\/merithon\/wp-json\/wp\/v2\/media\/984"}],"wp:attachment":[{"href":"https:\/\/digitalmerit.eu\/merithon\/wp-json\/wp\/v2\/media?parent=983"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}