InkSight is a project aiming to bridge the gap between traditional pen-and-paper note-taking and digital note-taking. It allows users to convert their physical handwritten notes (offline handwriting) into a digital ink format (online handwriting), a process referred to as ‘derendering’. Unlike previous approaches that focused on the geometric properties of images, InkSight combines reading and writing priors, effectively derendering handwritten text in photos with various visual characteristics and backgrounds. It even extends beyond its training domain into simple sketches. The technology does not require specialized equipment, only a picture of the handwritten note.
Publication date: 8 Feb 2024
Project Page: https://arxiv.org/abs/2402.05804v1
Paper: https://arxiv.org/pdf/2402.05804
