1<!doctype html><html lang="en" class="no-js"><head><meta charset="utf-8"> <!-- begin SEO --><title>Blog posts - Jonathan Lys</title><meta name="description" content="PhD student @ IMT Atlantique"><link rel="canonical" href="https://jonathanlys01.github.io/tech-blog/">
1<script type="application/ld+json"> { "@context" : "http://schema.org", "@type" : "Person", "name" : "Jonathan Lys", "url" : "https://jonathanlys01.github.io", "sameAs" : null } </script>
1 <!-- end SEO --> <!-- Open Graph protocol data (https://ogp.me/), used by social media --><meta property="og:locale" content="en-US"><meta property="og:site_name" content="Jonathan Lys"><meta property="og:title" content="Blog posts"><meta property="og:url" content="https://jonathanlys01.github.io/tech-blog/"> <!-- end Open Graph protocol --><link href="https://jonathanlys01.github.io/feed.xml" type="application/atom+xml" rel="alternate" title="Jonathan Lys Feed"><meta name="viewport" content="width=device-width, initial-scale=1.0">
1<script> document.documentElement.className = document.documentElement.className.replace(/\bno-js\b/g, '') + ' js '; </script>
1 <!-- For all browsers --><link rel="stylesheet" href="https://jonathanlys01.github.io/assets/css/main.css"> <!-- start custom head snippets --> <!-- Support for Academicons --><link rel="stylesheet" href="https://jonathanlys01.github.io/assets/css/academicons.css"/> <!-- favicon from https://commons.wikimedia.org/wiki/File:OOjs_UI_icon_academic-progressive.svg --><link rel="icon" type="image/svg+xml" href="https://jonathanlys01.github.io/images/favicon.svg"/><link rel="icon" type="image/png" href="https://jonathanlys01.github.io/images/favicon-32x32.png" sizes="32x32"/><link rel="icon" type="image/png" href="https://jonathanlys01.github.io/images/favicon-192x192.png" sizes="192x192"/><link rel="manifest" href="https://jonathanlys01.github.io/images/manifest.json"/><link rel="icon" href="/images/favicon.ico"/><meta name="theme-color" content="#ffffff"/> <!-- end custom head snippets --></head><body> <!--[if lt IE 9]><div class="notice--danger align-center" style="margin: 0;">You are using an <strong>outdated</strong> browser. Please <a href="http://browsehappy.com/">upgrade your browser</a> to improve your experience.</div><![endif]--><div class="masthead"><div class="masthead__inner-wrap"><div class="masthead__menu"><nav id="site-nav" class="greedy-nav"> <button><span class="navicon"></span></button><ul class="visible-links"><li class="masthead__menu-item masthead__menu-item--lg persist "> <a href="https://jonathanlys01.github.io/">Jonathan Lys</a></li><li class="masthead__menu-item "> <a href="https://jonathanlys01.github.io/cv-json/">CV</a></li><li class="masthead__menu-item "> <a href="https://jonathanlys01.github.io/publications/">Publications</a></li><li class="masthead__menu-item "> <a href="https://jonathanlys01.github.io/portfolio/">Portfolio</a></li><li class="masthead__menu-item selected"> <a href="https://jonathanlys01.github.io/tech-blog/">Posts</a></li><li id="theme-toggle" class="masthead__menu-item persist tail"> <a role="button" aria-labelledby="theme-icon"><i id="theme-icon" class="fa-solid fa-sun" aria-hidden="true" title="toggle theme"></i></a></li></ul><ul class="hidden-links hidden"></ul></nav></div></div></div><div id="main" role="main"><div class="archive"><h1 class="page__title">Blog posts</h1><h2 id="2025" class="archive__subtitle">2025</h2><div class="list__item"><article class="archive__item" itemscope itemtype="http://schema.org/CreativeWork"><h2 class="archive__item-title" itemprop="headline"> <a href="https://jonathanlys01.github.io/training-small-lms/" rel="permalink">Pre-training Small LMs </a></h2><p class="page__meta"> <span class="page__date"> <i class="fa fa-fw fa-calendar" aria-hidden="true"></i> <time datetime="2025-07-16T00:00:00+00:00"> Jul 16, 2025 </time> </span></p><span class="page__readtime"> | <i class="fa fa-clock" aria-hidden="true"></i> 7 minute read </span><span class="page__tags"> | <i class="fa fa-tags" aria-hidden="true"></i> <a href="https://jonathanlys01.github.io/tags#tech" rel="tag">tech</a>, <a href="https://jonathanlys01.github.io/tags#llm" rel="tag">llm</a></span><p class="archive__item-excerpt" itemprop="description"><p>Pre-train small LMs with a limited compute budget.</p></p></article></div><h2 id="2024" class="archive__subtitle">2024</h2><div class="list__item"><article class="archive__item" itemscope itemtype="http://schema.org/CreativeWork"><h2 class="archive__item-title" itemprop="headline"> <a href="https://jonathanlys01.github.io/ficus-published/" rel="permalink">Site Launch - Accepted paper at EUSIPCO 2024 </a></h2><p class="page__meta"> <span class="page__date"> <i class="fa fa-fw fa-calendar" aria-hidden="true"></i> <time datetime="2024-05-22T00:00:00+00:00"> May 22, 2024 </time> </span></p><span class="page__readtime"> | <i class="fa fa-clock" aria-hidden="true"></i> less than 1 minute read </span><span class="page__tags"> | <i class="fa fa-tags" aria-hidden="true"></i> <a href="https://jonathanlys01.github.io/tags#announcements" rel="tag">announcements</a>, <a href="https://jonathanlys01.github.io/tags#publications" rel="tag">publications</a></span>
1<p class="archive__item-excerpt" itemprop="description"><p>Announcement: first paper accepted as an oral at EUSIPCO</p></p></article></div></div></div><div class="page__footer"><footer> <!-- start custom footer snippets --> <!-- Support for MatJax -->
1<script defer src="https://cdnjs.cloudflare.com/polyfill/v3/polyfill.min.js?features=es6"></script>
1
1<script defer src="https://cdn.jsdelivr.net/npm/mathjax@3/es5/tex-mml-chtml.js" id="MathJax-script"></script>
1 <!-- Support for Mermaid -->
1<script type="module"> import mermaid from 'https://cdn.jsdelivr.net/npm/mermaid@11/dist/mermaid.esm.min.mjs'; mermaid.initialize({startOnLoad:true, theme:'default'}); await mermaid.run({querySelector:'code.language-mermaid'}); </script>
1 <!-- end custom footer snippets --><div class="page__footer-follow"><ul class="social-icons"><li><strong>Follow:</strong></li><li><a href="https://github.com/jonathanlys01"><i class="fab fa-github" aria-hidden="true"></i> GitHub</a></li><li><a href="https://jonathanlys01.github.io/feed.xml"><i class="fa fa-fw fa-rss-square" aria-hidden="true"></i> Feed</a></li></ul></div><div class="page__footer-copyright"> © 2026 Jonathan Lys, Powered by <a href="https://jekyllrb.com" rel="nofollow">Jekyll</a> & <a href="https://github.com/academicpages/academicpages.github.io">AcademicPages</a>, a fork of <a href="https://mademistakes.com/work/minimal-mistakes-jekyll-theme/" rel="nofollow">Minimal Mistakes</a>.<br /> Site last updated 2026-07-05</div></footer></div>
1<script type="module" src="https://jonathanlys01.github.io/assets/js/main.min.js"></script>
1
1<script src="https://jonathanlys01.github.io/assets/js/haltools.js"></script>
1</body></html>
Line numbers count LF bytes from the start of the resource, as the search results do. Vendor segments are library code the classifier recognised; they are stored but not indexed. Bytes are shown as Latin1 characters, one per byte.