The article ‘Inadequacies of Large Language Model Benchmarks in the Era of Generative Artificial Intelligence’ critically assesses 23 state-of-the-art LLM benchmarks. The authors highlight significant limitations, such as biases, difficulties…
Continue readingThe paper presents ‘CyberMetric’, a benchmark dataset composed of 10,000 questions from various cybersecurity sources. The dataset’s purpose is to assess and compare the knowledge of large language models (LLMs),…
Continue readingThe article introduces a new dataset called DAPlankton that is aimed at developing and benchmarking domain adaptation methods for image recognition. Different imaging instruments and local differences in plankton species…
Continue readingThe paper presents a new dataset called DAPlankton for developing and benchmarking domain adaptation methods for image recognition. The data consists of phytoplankton images captured using different imaging instruments. This…
Continue readingThe article introduces UAV-Rain1k, a new benchmark dataset for removing raindrops from unmanned aerial vehicle (UAV) images. The researchers created the dataset to address the lack of focus on raindrop…
Continue readingThe study introduces CMMU, a benchmark tool for evaluating the understanding and reasoning abilities of multi-modal large language models (MLLMs) in Chinese. It comprises 3,603 questions across 7 subjects, covering…
Continue readingThe article presents LLpowershap, a novel feature selection method that uses loss-based Shapley values to identify informative features and reduce noise. The method also demonstrates higher or equal predictive performance…
Continue readingThe article introduces ALIGN BENCH, a comprehensive benchmark for evaluating alignment in Large Language Models (LLMs) for the Chinese language. The benchmark utilizes a human-in-the-loop data curation pipeline and includes…
Continue readingThe paper discusses the application of Large Language Models (LLMs) in penetration testing, with a focus on Linux privilege escalation. The authors developed a benchmark for Linux privilege escalation and…
Continue readingThe article presents MalDICT, a collection of four benchmark datasets that support different, under-represented malware classification tasks. Malware can be classified according to various attributes, and the ability to identify…
Continue readingLooks like you're using an ad blocker. Please support us by disabling these ad blocker.
