Welcome to the final episode of the <LLM Evaluation Trilogy>. In the previous letters, we explored the definition, significance, and examples of LLM evaluation. Today, we will dive into the detailed process of how MoMoJam’s AI safety was evaluated. 1️⃣ What...

OpenAI hs recently released it’s new model o1. Each time a new model is released, researchers explore new fields where the model can be applied. On September 23rd, a paper titled <A Preliminary Study of o1 in Medicine: Are We Closer...

Welcome to our second episode of <LLM Evaluation Trilogy>, presented by Datumo’s NLP researchers! 1️⃣ What is LLM evaluation? 2️⃣ LLM safety evaluation & specific examples 3️⃣ Safety evaluation results of a specific model Following the first part, “What is LLM...

LLM evaluation is more complex than it might seem. Since the emergence of ChatGPT (November 30, 2022) [1], a wave of Large Language Models (LLMs) has been released as if in competition. Just in 2024 alone, we’ve seen the launch of...

On July 29th, Meta unveiled SAM (Segment Anything Model) 2. It has been 1 year and 4 months since the initial release of SAM in April 2023. Let’s take a closer look at how much it has changed! 🧐 Segmentation’s...

One of the most effective methods for reducing hallucinations in language models is generating answers based on search results, and a prime example of this is RAG. RAG, or Retrieval-Augmented Generation, involves using search-augmented generation techniques, where the language model...

Recently, competition among chatbot models has reignited. Models like Bard and Gemini have sparked anticipation with each release, hoping to surpass GPT-4, but they haven’t quite succeeded. However, many claim that the newly released Claude-3 family by Anthropic provides responses...