Source: Microsoft

Headline: Microsoft supports making Europe’s languages and cultures more accessible in the digital realm

Editor’s Note: This blog is also available in Italian, Spanish, French, and German.

Europe is home to more than 200 languages and a rich cultural legacy that spans thousands of years, preserved in millions of cultural assets that tell the story of its people. But these languages are more than carriers of heritage and history—they support both culture and commerce by making it possible for people to connect, create, and do business.

Yet, as the world digitizes, much of Europe’s linguistic and cultural diversity risks being left behind. The majority of online web content—the primary source of training data for today’s Large Language Models (LLMs)—is in English. Much of it reflects an American perspective. The European Commission has warned that the continent’s ambition to digitize its vast cultural corpus remains “significantly out of reach.” As Europe’s leaders have recognized, without urgent action, this imbalance is not just a cultural concern—it’s a commercial one. AI that doesn’t understand Europe’s languages, histories, and values can’t fully serve its people, its businesses, or its future.

That’s why today in Paris, we’re deepening our commitment to Europe’s digital future with two new initiatives focused on making what’s uniquely European more open and accessible—its languages and culture. This builds on our European Digital Commitments, announced earlier this year, to expand AI and cloud infrastructure, strengthen digital resilience and data privacy protections, enhance cybersecurity, and support Europe’s digital sovereignty and broader economy.

First, to support the development of more multilingual LLMs in Europe and for Europe, we’re basing employees from two of our innovation centers in Strasbourg, France—long a crossroads of cultures and now home to key European institutions. These centers will help expand the availability of multilingual data for AI development—leveraging Microsoft Azure, our technical expertise, and partnerships across Europe to promote more inclusive language representation in AI models. As part of this effort, we’re also issuing a call for proposals to help expand the supply of digital content for 10 European languages.

Second, to help ensure Europe’s cultural richness is represented and accessible in the digital realm, we’re expanding Microsoft’s Culture AI initiative, which helps to safeguard languages, landmarks, and artifacts through digital replicas and data collaboration. Since 2019, Microsoft has digitally preserved heritage including Ancient Olympia in Greece, Mount St. Michel in France, St. Peter’s Basilica in Rome, and the 80th Anniversary of the Allied Beach Landings in Normandy, to name a few. Today we’re announcing that this fall, Microsoft will begin work with the French Ministry of Culture and the French firm Iconem to create a digital replica of Notre Dame—Paris’ newly restored, 862-year-old Gothic masterpiece.

This type of support for Europe and its diversity is not new to Microsoft. These latest steps to support languages and culture are informed by our more than 40 years of experience serving countries and cultures across Europe and around the world. Early on, we learned that empowering every person on the planet requires that the technologies we offer must be available in the languages the world speaks. That is why today Windows supports over 90 languages, including all official European Union languages as well as languages including Basque, Catalan, Galician, Luxembourgish, Valencian, and more. Microsoft 365 also has a broad reach, with support through Office applications in more than 30 European languages, including all official languages of the European Union.

The urgency of bridging the language gap

The European Union has 24 official languages, with dozens more acknowledged at the national or regional level. Yet many of these languages—even those that are part of the official 24, like Danish, Finnish, Swedish, and Greek—represent less than 0.6% of web content. Others, such as Maltese, Irish, Estonian, Latvian, and Slovenian, are barely visible online. While only 5% of the world’s population speaks English as a first language, English text makes up half of web content, dominating the data used to train AI models.

This digital underrepresentation has real consequences, as LLMs rely heavily on web content for training. When a language lacks sufficient online presence, it risks being excluded from future AI services. While larger, general-purpose models can handle multiple languages, they can still miss the linguistic nuance, cultural context, and regional depth needed for truly inclusive applications. LLMs trained on limited data are less accurate, have higher hallucinations and errors, struggle with vocabulary, and reflect more bias.^[1]

As an example, Llama 3.1, a popular open source model, shows a performance gap of more than 15 percentage points between answering in English and Greek and a gap of more than 25 points when comparing English to Latvian. This mean that if this model was a high school student, she would be at the top of her class in English but at the middle of her class in Greek and at the bottom in Latvian. And this disparity between languages is seen in all major performance LLM tests.^[2]

In many cases, languages with deep cultural heritage, such as Breton, Occitan, and Romansh, which UNESCO classifies as endangered, are largely unsupported in today’s mainstream AI systems.

The economic power of language

This lopsided development of language models has real economic consequences. When AI systems can’t understand or respond in a region’s language, they limit access to services and opportunities, undermining both local businesses and broader economic growth.

Broad AI diffusion—adoption and use across economies—will be one of the most important drivers of innovation and productivity growth over the next decade. Like electricity and other general-purpose technologies in the past, AI represents the next stage of industrialization.

For communities whose languages are underrepresented online, the benefits of AI risk remaining out of reach. Imagine a small business owner in Malta who speaks only Maltese. Currently, the advanced AI tools for tasks like market analysis or content generation likely don’t operate in Maltese, limiting how this entrepreneur can leverage AI. Or consider a Polish-speaking student in a town outside Warsaw who can’t find AI educational resources in his language, potentially impacting learning opportunities. And even when an AI platform nominally supports a language, the experience may be sub-par.

European governments and institutions have recognized the importance of addressing this situation. To drive economic competitiveness in the AI era, Europe will need to break down the language barriers and spur AI diffusion across the continent. According to the European Commission, only 13.5% of EU businesses use AI. The EU AI Continent Action Plan notes that breaking down language barriers in the single market could boost intra-EU trade by up to EUR 360 billion.

New steps to address language gaps

To help bridge this language gap, Microsoft will collaborate with European partners to increase the availability of multilingual data. In partnership with the ICube Laboratory at the University of Strasbourg—an institution dedicated to engineering, computer science, and imaging—we will support AI training efforts by placing personnel from the Microsoft Open Innovation Center (MOIC) and our AI for Good Lab in Strasbourg, France. This team will be backed by a global internal network of more than 70 Microsoft engineers, data scientists, and policy professionals. This collaboration between the MOIC, Microsoft AI for Good Lab, and the University of Strasbourg will also fund two post-doctoral researchers and provide up to US $1 million in Azure credits.

This team will start by tapping into Microsoft’s own store of multilingual data, making it accessible and transparent to the European public, including open source developers. This includes, for example, multilingual text data from GitHub and voice data sets. MOIC and GitHub will partner with Hugging Face, a popular collaboration platform for AI model development, to host and make the data broadly accessible. This builds on our existing relationship with Hugging Face to make a broad range of open models in the Hugging Face model collection available for 1-click deployment in the Azure Model Catalogue. This includes last week’s release of the latest contributions toward multilingual AI—the SmoILM3 model, a highly efficient 3B model parameter multi-lingual model with support for 6 languages: English, French, Spanish, German, Italian, and Portuguese.

MOIC will also partner with Common Crawl, one of the largest free and open repositories of web crawled data. MOIC will fund work at Common Crawl, leveraging native speakers to annotate and seed European language data in the publicly available Common Crawl data set.

In addition, the MOIC and the AI for Good Lab will issue a call for proposals to help expand the supply of digital content for 10 European languages by making their text collections available responsibly and ethically on their own terms for multilingual AI development and experiences. Applications for grants will be available on the AI for Good Lab website, beginning on 1 September 2025. In selecting recipients, the MOIC and the AI for Good Lab will focus on opportunities to unlock data in languages with relatively low representation in online content, such as Estonian, Alsatian, Slovak, Greek, and Maltese. Grants will provide recipients with Azure credits and engineering and technical support.

While more multilingual data is essential, better technology tools and know-how can also help. For example, many languages use scripts (writing systems) that currently pose challenges for models originally designed for the Latin alphabet. Cyrillic characters, the Greek alphabet, and Arabic’s cursive script each have different properties. Off-the-shelf “tokenizers” often break these scripts in suboptimal ways. This can hurt a model’s ability to learn long-range context or accurate spelling in those languages. New advances in techniques that enable a model to handle any script uniformly can help. Better mechanisms to create synthetic data and to better process and curate that data can also help, especially when they manage privacy and sensitive data concerns effectively.

The MOIC and the AI for Good Lab will work to facilitate the development and sharing of knowledge, tools, and capabilities to address these issues and empower European developers. The AI for Good Lab will publish a blueprint to detail how to create high-quality language datasets and train local LLMs to get more power out of the data that exists. These two groups will also support relevant research, organize convenings, co-invest in data commons projects, and ensure that knowledge, tools, and capabilities are available where they’re needed most. These teams also will continue to support efforts such as those of the Barcelona Supercomputing Center, Basque Center for Language Technology, and the University of Santiago de Compostela to release AI models trained in Spanish, Catalan, Basque, and Galician on Azure AI Foundry. This initiative empowers developers to build AI systems that operate in Spain’s official languages, fostering innovation and inclusivity.

Finally, to advance responsible AI research and help close the language gap, Microsoft is launching two new academic collaborations in Europe at the University of Strasbourg and IE University School of Science & Technology in Spain. Microsoft’s AI for Good Lab and MOIC will partner with the University of Strasbourg to provide Azure grants to support joint AI research. At IE University School of Science & Technology, the Microsoft AI for Good Lab will provide Azure grants to support joint research targeting low resource languages, including support for related capstone projects to accelerate new solutions focused on language and AI.

New steps to help digitally safeguard Europe’s cultural legacy

Since 2019, Microsoft’s Culture AI initiative has focused on using artificial intelligence around the world to help preserve the languages, places, stories, and artifacts that define human history.  Powered by the AI for Good Lab and through partnerships with nonprofits, universities, governments, and cultural institutions, the initiative supports projects that digitize and protect cultural heritage—from endangered languages to iconic landmarks, including in France, Rome, and Greece. Whether it’s creating digital replicas of historic sites or making museum collections more accessible, the goal is to ensure that cultural identity and diversity are not only preserved but made more inclusive and discoverable in the digital age.

Today we are announcing our next project, building a digital replica in partnership with the French Ministry of Culture and the French firm Iconem. The project will create a digital twin of Notre Dame in Paris, an architectural and cultural landmark shaped over centuries. Construction of Notre Dame began in 1163 and continued for nearly 200 years, resulting in a 128-meter-long Gothic masterpiece with twin towers rising 69 meters above the Seine. After a devastating fire in 2019, Notre Dame re-opened to the public at the end of 2024. The project will use the technology and methods we developed with Iconem to create a digital twin of St. Peter’s Basilica last year, which was based on more than 400,000 photos and advanced AI algorithms, in partnership with the Vatican.

Just as last year’s project documented for the Vatican every detail of St. Peter’s, this new project will create a digital replica that will preserve permanently in digital form every detail of Notre Dame, ensuring that its structure, story, and symbolism are protected and accessible for generations to come. By combining advanced imaging with AI, we will create and donate to the French State a digital twin that can be used by preservationists and be displayed in the future Musée Notre Dame de Paris.

In addition to the project at Notre Dame, we are also announcing today a partnership with the Bibliothèque Nationale de France and in collaboration with Iconem to digitize nearly 1,500 cinematic model sets from shows at the Opera National de Paris between 1800 and 1914. The digitized model sets will be made available through interactive, educational experiences and exhibitions and as a dataset made available on the Bibliothèque Nationale de France’s Gallica platform for cultural AI and research projects.

Finally, we are embarking on new work with the Musée des Arts Décoratifs to make publicly accessible the detailed digital descriptions of approximately 1.5 million artifacts from the Middle Ages to the present day. This step will enable researchers in history, art history, and conservation to access this new information for study and use in their own AI-driven research.

Looking ahead: Taking a principled approach

We take these new steps today with humility and respect, recognizing that the preservation of Europe’s linguistic and cultural diversity is a task for Europeans to be led by Europeans. The European Union has already launched a multi-state effort to pool EU language data and digitize all types of cultural heritage. Our role is to contribute to and support these and similar efforts. None of what we are announcing today will create any proprietary data or technology for Microsoft itself.

Ultimately, the best way to empower more people across Europe to address these needs is to equip them with the AI skills that will enable them to be successful in these fields. As the European Commission recently concluded, a deficit of digital skills in the cultural sector is inhibiting efforts to digitalize cultural heritage works across Europe. To help bridge this skills gap, the MOIC and the AI for Good Lab will share what we know and learn about how to do this critical work.

Technology should reflect the richness of humanity—not strip it away. By taking intentional steps now, we can help ensure that AI doesn’t erase linguistic and cultural diversity but strengthens it.

This is one of the defining equity challenges of the AI era. And if we work together—with purpose and urgency—we can close the gap and build a digital future that honors every language, every culture, and every community across Europe.

[1] P. Rohera, C. Ginimav, G. Sawant, and R. Joshi, “Better To Ask in English? Evaluating Factual Accuracy of Multilingual LLMs in English and Low-Resource Languages,” Apr. 28, 2025, arXiv: arXiv:2504.20022. doi: 10.48550/arXiv.2504.20022.

[2] K. Thellmann et al., “Towards Multilingual LLM Evaluation for European Languages,” Oct. 17, 2024, arXiv: arXiv:2410.08928. doi: 10.48550/arXiv.2410.08928.