1<!DOCTYPE html> 2<html lang="en" > 3<head> 4 <meta name="generator" content="Hugo 0.73.0" /> 5 <meta charset="utf-8" /> 6 <meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1" /> 7 <meta name="viewport" content="width=device-width, initial-scale=1" /> 8 <meta name="author" content="Max Hoffman" /> 9 10 11 12 <title>Max Hoffman ï½ mlops | startups </title> 13 14 15 16 <meta name="description" content="description" /> 17 18 19 20 21 <meta name="keywords" content="Max Hoffman, data, engineering, ml, data science" /> 22 23 24 25 <link rel="alternate" type="application/rss+xml" href="https://hoffman.ai/index.xml" title="Max Hoffman" /> 26 27 28 <link rel="shortcut icon" href="https://hoffman.ai/images/favicon.png" /> 29 <link rel="icon" href="https://hoffman.ai/images/favicon.png" /> 30 31 <link rel="stylesheet" type="text/css" media="screen" href="https://hoffman.ai/css/normalize.css" /> 32 <link rel="stylesheet" type="text/css" media="screen" href="https://cdn.jsdelivr.net/npm/[email protected]/animate.min.css" /> 33 <link rel="stylesheet" type="text/css" media="screen" href="https://hoffman.ai/css/zozo.css" /> 34 <link rel="stylesheet" type="text/css" media="screen" href="https://cdn.jsdelivr.net/npm/[email protected]/fonts/remixicon.css" /> 35 <link rel="stylesheet" type="text/css" media="screen" href="https://hoffman.ai/css/highlight.css" /> 36 37 38 39 <link rel="stylesheet" href="https://hoffman.ai/css/styles.css" /> 40 41 42 43 44
44<script>
vendor: 379 bytes, lines 44-50
44 45 (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){ 46 (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o), 47 m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m) 48 })(window,document,'script','https://www.google-analytics.com/analytics.js','ga'); 49 50 ga('create', "
50UA-161423111-1
vendor: 49 bytes, lines 50-52
50" , 'auto'); 51 ga('send', 'pageview'); 52
52</script>
52 53 54</head> 55 56 57<body> 58 <div class="main animate__animated animate__fadeInDown"> 59 <div class="nav_container animated fadeInDown"> 60 <div class="site_nav" id="site_nav"> 61 <ul> 62 63 <li> 64 <a href="/">Home</a> 65 </li> 66 67 <li> 68 <a href="/posts/">Archive</a> 69 </li> 70 71 <li> 72 <a href="/tags/">Tags</a> 73 </li> 74 75 <li> 76 <a href="/about/">About</a> 77 </li> 78 79 <li> 80 <a href="/baking/">Baking</a> 81 </li> 82 83 </ul> 84 </div> 85 <div class="menu_icon"> 86 <a id="menu_icon"><i class="ri-menu-line"></i></a> 87 </div> 88</div> 89 <div class="header animated fadeInDown"> 90 <div class="site_title_container"> 91 <div class="site_title"> 92 <h1> 93 <a href="https://hoffman.ai/"> 94 <span>Max Hoffman</span> 95 </a> 96 </h1> 97 </div> 98 <div class="description"> 99 <p class="sub_title">mlops | startups</p> 100 <div class="my_socials"> 101 102 103 <a href="%20" title="facebook" target="_blank"><i class="ri-facebook-fill"></i></a> 104 105 106 107 <a href="https://github.com/max-hoffman" title="github" target="_blank"><i class="ri-github-fill"></i></a> 108 109 110 111 <a href="https://www.instagram.com/maxwhoffman/" title="instagram" target="_blank"><i class="ri-instagram-fill"></i></a> 112 113 114 115 <a href="https://twitter.com/maxwhoffman" title="twitter" target="_blank"><i class="ri-twitter-fill"></i></a> 116 117 118 <a href="https://hoffman.ai/index.xml" type="application/rss+xml" title="rss" target="_blank"><i 119 class="ri-rss-fill"></i></a> 120 </div> 121 </div> 122 </div> 123</div> 124 125 <div class="content"> 126 127 128<div class="post animated fadeInDown"> 129 <div class="post_title"> 130 <h2><a href='/posts/mypy/'>Mypy and Doltpy</a></h2> 131 </div> 132 133 <div class="list"> 134 <div class="post_content markdown"> 135 <p>This is a cross-post from Dolthub’s Blog. 136Dolt Dolt is an SQL-database with Git-versioning. The goal of Doltpy, in concert with Dolt, is to solve reproducibility and versioning problems for data and machine learning engineers using Python. 137Mypy Mypy was created by Guido van Rossum, the primary developer of the Python language, as a way to apply PEP standards to Python source code....</p> 138 </div> 139 </div> 140 141 <div class="post_footer"> 142 <div class="meta"> 143 <div class="info"> 144 <span class="field"> 145 <i class="ri-map-pin-time-line"></i> 146 <span class="date">2021.02.22</span> 147 </span> 148 149 </div> 150 </div> 151 </div> 152</div> 153 154<div class="post animated fadeInDown"> 155 <div class="post_title"> 156 <h2><a href='/posts/lambda-mr/'>Lambda MR</a></h2> 157 </div> 158 159 <div class="list"> 160 <div class="post_content markdown"> 161 <p>What problems to Spark and Map Reduce solve? Was Spark the next generation of MapReduce? Do they solve the same problem? Is Spark quick and failure-prone, while MapReduce is slow and reliable? 162To play devil’s advocate, I think MapReduce was the right abstraction for the wrong problem....</p> 163 </div> 164 </div> 165 166 <div class="post_footer"> 167 <div class="meta"> 168 <div class="info"> 169 <span class="field"> 170 <i class="ri-map-pin-time-line"></i> 171 <span class="date">2020.06.05</span> 172 </span> 173 174 <span class="field tags"> 175 <i class="ri-stack-line"></i> 176 177 <a href="https://hoffman.ai/tags/data/">data</a> 178 179 <a href="https://hoffman.ai/tags/spark/">spark</a> 180 181 <a href="https://hoffman.ai/tags/map-reduce/">map-reduce</a> 182 183 <a href="https://hoffman.ai/tags/ml/">ml</a> 184 185 <a href="https://hoffman.ai/tags/mlops/">mlops</a> 186 187 </span> 188 189 </div> 190 </div> 191 </div> 192</div> 193 194<div class="post animated fadeInDown"> 195 <div class="post_title"> 196 <h2><a href='/posts/mlops-segmentation/'>MLOps Segmentation</a></h2> 197 </div> 198 199 <div class="list"> 200 <div class="post_content markdown"> 201 <p>I was doing some market analysis on data science tools, and broke down categories along a “hand-holding” metric. I think this falls back to the same “correctness principle” that I mentioned in the workflow article, where there is a balance between lightweight tools that flexibly bend to the user’s need, and heavy-weight tools that do “everything” in a narrow and opinionated way....</p> 202 </div> 203 </div> 204 205 <div class="post_footer"> 206 <div class="meta"> 207 <div class="info">
208 <span class="field"> 209 <i class="ri-map-pin-time-line"></i> 210 <span class="date">2020.06.02</span> 211 </span> 212 213 <span class="field tags"> 214 <i class="ri-stack-line"></i> 215 216 <a href="https://hoffman.ai/tags/data/">data</a> 217 218 <a href="https://hoffman.ai/tags/market-analysis/">market analysis</a> 219 220 <a href="https://hoffman.ai/tags/mlops/">mlops</a> 221 222 <a href="https://hoffman.ai/tags/data-science/">data science</a> 223 224 </span> 225 226 </div> 227 </div> 228 </div> 229</div> 230 231<div class="post animated fadeInDown"> 232 <div class="post_title"> 233 <h2><a href='/posts/spark-tf/'>Unrealistic DS - Spark Tensorflow</a></h2> 234 </div> 235 236 <div class="list"> 237 <div class="post_content markdown"> 238 <p>People aren’t afraid of autocrats. People are afraid of being different from thier neighbors. -Jacob Snell (Ozark) 239 These are a few ideas that might not be possible to develop right now (or might not even be good ideas in practice), but originate from pain points in my work....</p> 240 </div> 241 </div> 242 243 <div class="post_footer"> 244 <div class="meta"> 245 <div class="info"> 246 <span class="field"> 247 <i class="ri-map-pin-time-line"></i> 248 <span class="date">2020.05.27</span> 249 </span> 250 251 <span class="field tags"> 252 <i class="ri-stack-line"></i> 253 254 <a href="https://hoffman.ai/tags/spark/">spark</a> 255 256 <a href="https://hoffman.ai/tags/tf/">tf</a> 257 258 <a href="https://hoffman.ai/tags/data-science/">data science</a> 259 260 <a href="https://hoffman.ai/tags/data/">data</a> 261 262 <a href="https://hoffman.ai/tags/mlops/">mlops</a> 263 264 </span> 265 266 </div> 267 </div> 268 </div> 269</div> 270 271<div class="post animated fadeInDown"> 272 <div class="post_title"> 273 <h2><a href='/posts/minimalist-workflow-execution/'>Unrealistic DS - Minimalist Workflows</a></h2> 274 </div> 275 276 <div class="list"> 277 <div class="post_content markdown"> 278 <p>Right-thing philosophy is based on letting the experts do their expert thing all the way to the end before users get their hands on it. [But] in some cases, the software system that succeeds starts with a kernel of good technology, but it is not committed to fully realizing that technology....</p> 279 </div> 280 </div> 281 282 <div class="post_footer"> 283 <div class="meta"> 284 <div class="info"> 285 <span class="field"> 286 <i class="ri-map-pin-time-line"></i> 287 <span class="date">2020.04.14</span> 288 </span> 289 290 </div> 291 </div> 292 </div> 293</div> 294 295<div class="post animated fadeInDown"> 296 <div class="post_title"> 297 <h2><a href='/posts/pandas-spark-dataframes/'>Unrealistic DS - Pandas/Spark Subset</a></h2> 298 </div> 299 300 <div class="list"> 301 <div class="post_content markdown"> 302 <p>Design doesnât have to be new, but it has to be good. Research doesnât have to be good, but it has to be new… The best design surpasses its predecessors by using new ideas, and the best research solves problems that are not only new, but worth solving....</p> 303 </div> 304 </div> 305 306 <div class="post_footer"> 307 <div class="meta"> 308 <div class="info"> 309 <span class="field"> 310 <i class="ri-map-pin-time-line"></i> 311 <span class="date">2020.04.10</span> 312 </span> 313
314 <span class="field tags"> 315 <i class="ri-stack-line"></i> 316 317 <a href="https://hoffman.ai/tags/pandas/">pandas</a> 318 319 <a href="https://hoffman.ai/tags/spark/">spark</a> 320 321 <a href="https://hoffman.ai/tags/mlops/">mlops</a> 322 323 <a href="https://hoffman.ai/tags/data-science/">data science</a> 324 325 <a href="https://hoffman.ai/tags/data/">data</a> 326 327 </span> 328 329 </div> 330 </div> 331 </div> 332</div> 333 334 335<div class="pagination"> 336 337 338 339 <a href="/page/2/" class="next"> 340 341 </a> 342 343 344</div> 345 346 </div> 347 </div> 348 <footer class="footer"> 349 <div class="powered_by"> 350 <a href="https://www.linkedin.com/in/max-hoffman-04790aa6/">© 2020 Max Hoffman, </a> 351 <a href="https://varkai.com">Theme by VarKai,</a> 352 <a href="http://www.gohugo.io/">Built with Hugo</a> 353 </div> 354 355 <div class="footer_slogan"> 356 <span>The beginning of an acquaintance whether with persons or things is to get a definite outline of our ignorance.</span> 357 </div> 358</footer> 359 360
360<script src="https://hoffman.ai/js/jquery-3.5.1.min.js"></script>
360 361<link href="https://hoffman.ai/css/fancybox.min.css" rel="stylesheet">
362<script src="https://hoffman.ai/js/fancybox.min.js"></script>
vendor: 1 bytes, line 362
362
363<script src="https://hoffman.ai/js/zozo.js"></script>
363 364 365
366<script type="text/javascript" async 367 src="https://cdn.bootcss.com/mathjax/2.7.5/MathJax.js?config=TeX-AMS-MML_HTMLorMML"> 368 MathJax.Hub.Config({ 369 tex2jax: { 370 inlineMath: [['$', '$'], ['\\(', '\\)']], 371 displayMath: [['$$', '$$'], ['\[\[', '\]\]']], 372 processEscapes: true, 373 processEnvironments: true, 374 skipTags: ['script', 'noscript', 'style', 'textarea', 'pre'], 375 TeX: { 376 equationNumbers: { autoNumber: "AMS" }, 377 extensions: ["AMSmath.js", "AMSsymbols.js"] 378 } 379 } 380 }); 381 382 MathJax.Hub.Queue(function () { 383 384 385 386 var all = MathJax.Hub.getAllJax(), i; 387 for (i = 0; i < all.length; i += 1) { 388 all[i].SourceElement().parentNode.className += ' has-jax'; 389 } 390 }); 391 </script>
391 392 393<style> 394 code.has-jax { 395 font: inherit; 396 font-size: 100%; 397 background: inherit; 398 border: inherit; 399 color: #515151; 400 } 401</style> 402 403 404
405<script type="application/javascript"> 406var doNotTrack = false; 407if (!doNotTrack) { 408 window.ga=window.ga||function(){(ga.q=ga.q||[]).push(arguments)};ga.l=+new Date; 409 ga('create', 'UA-161423111-1', 'auto'); 410 411 ga('send', 'pageview'); 412} 413</script>
vendor: 1 bytes, line 413
413
414<script async src='https://www.google-analytics.com/analytics.js'></script>
414 415 416 417 418</body> 419 420</html>
Line numbers count LF bytes from the start of the resource, as the search results do. Vendor segments are library code the classifier recognised; they are stored but not indexed. Bytes are shown as Latin1 characters, one per byte.