Post by regenold

𝗔𝗜 𝗮𝘀𝘀𝗶𝘀𝘁𝗮𝗻𝘁𝘀 𝗰𝗮𝗻 𝘀𝗼𝘂𝗻𝗱 𝘃𝗲𝗿𝘆 𝗰𝗼𝗻𝗳𝗶𝗱𝗲𝗻𝘁. 𝗕𝘂𝘁 𝗮𝗿𝗲 𝘁𝗵𝗲𝘆 𝗮𝗰𝘁𝘂𝗮𝗹𝗹𝘆 𝗿𝗲𝗴𝘂𝗹𝗮𝘁𝗼𝗿𝘆-𝗿𝗲𝗮𝗱𝘆? We recently tested several off-the-shelf AI assistants on regulatory questions based on the EU AI Act, MDR and EMA guidance. Many responses looked convincing - yet around 30% contained serious issues. This new article written by Marco Virgolin, PhD explains why generalist AI tools aren’t enough for regulated environments, and why purpose-built assistants and robust evaluation frameworks (Evals) are needed.