This repository provides access to two critical benchmarks designed to advance the development and evaluation of large language models (LLMs) in Thai: ThaiCLI for evaluating cultural intelligence a…

KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Models

The Universe of Evaluation. All about the evaluation for LLMs.

The Universe of Data. All about data, data science, and data engineering

Public repo for HF blog posts

☁️ 구름(KULLM): 고려대학교에서 개발한, 한국어에 특화된 LLM

[Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation

한국어 생성 모델의 상식 추론을 위한 KommonGen 데이터셋입니다.

Fast inference engine for Transformer models

Fast and customizable text tokenization library with BPE and SentencePiece support

Open Source Neural Machine Translation and (Large) Language Models in PyTorch

Neural machine translation and sequence learning using TensorFlow