Deepfakes for scrawl: With handwriting synthesis, no pen is necessary

Thanks to a free web app called calligrapher.ai, anyone can simulate handwriting with a neural network that runs in a browser via JavaScript. After typing a sentence, the site renders it as handwriting in nine different styles, each of which is adjustable with properties such as speed, legibility, and stroke width. It also allows downloading the resulting faux handwriting sample in an SVG vector file.

The demo is particularly interesting because it doesn’t use a font. Typefaces that look like handwriting have been around for over 80 years, but each letter comes out as a duplicate no matter how many times you use it.

During the past decade, computer scientists have relaxed those restrictions by discovering new ways to simulate the dynamic variety of human handwriting using neural networks.

Created by machine-learning researcher Sean Vasquez, the Calligrapher.ai website utilizes research from a 2013 paper by DeepMind’s Alex Graves. Vasquez originally created the Calligrapher site years ago, but it recently gained more attention with a rediscovery on Hacker News.

Calligrapher.ai “draws” each letter as if it were written by a human hand, guided by statistical weights. Those weights come from a recurrent neural network (RNN) that has been trained on the IAM On-Line Handwriting Database, which contains samples of handwriting from 221 individuals digitized from a whiteboard over time. As a result, the Calligrapher.ai handwriting synthesis model is heavily tuned toward English-language writing, and people on Hacker News have reported trouble reproducing diacritical marks that are commonly found in other languages.

Since the algorithm producing the handwriting is statistical in nature, its properties, such as “legibility,” can be adjusted dynamically. Vasquez described how the legibility slider works in a comment on Hacker News in 2020: “Outputs are sampled from a probability distribution, and increasing the legibility effectively concentrates probability density around more likely outcomes. So you’re correct that it’s just altering variation. The general technique is referred to as ‘adjusting the temperature of the sampling distribution.'”

With neural networks now tackling text, speech, pictures, video, and now handwriting, it seems like no corner of human creative output is beyond the reach of generative AI.

In 2018, Vasquez provided underlying code that powers the web app demo on GitHub, so it could be adapted to other applications. In the right context, it might be useful for graphic designers who want more flair than a static script font.