Skip to main content

Posts

Showing posts from July, 2020

MMDF: Mobile Microscopy Deep Framework

- By Anatasiia Kornilova , Mikhail Salnikov, Olga Novitskaya, Maria Begicheva, Egor Sevriugov, Kirill Shcherbakov  Paper Link Github Code Abstract  In the last decade, a huge step was done in the field of mobile microscopes development as well as in the field of mobile microscopy application to real-life disease diagnostics and a lot of other important areas (air/water quality pollution, education, agriculture). In the current study, we applied image processing techniques from Deep Learning (in-focus/out-of-focus classification, image deblurring and denoising, multi-focus image fusion) to the data obtained from the mobile microscope. Overview of significant works for every the task is presented, the most suitable approaches were highlighted. With the development of optical microscopy technologies, the cost of simple microscopes has become low enough for their mass usage. A considerable role in that class plays mobile microscopy – the field where smartphone camera and computational reso

WAV2SHAPE: HEARING THE SHAPE OF A DRUM MACHINE

-By Han Han, Vincent Lostanlen  New York University Paper Link ABSTRACT  Disentangling and recovering physical attributes, such as shape and material, from a few waveform examples is a challenging inverse problem in audio signal processing, with numerous applications in musical acoustics as well as structural engineering. We propose to address this problem via a combination of time–frequency analysis and supervised machine learning. We start by synthesizing a dataset of sounds using the functional transformation method. Then, we represent each percussive sound in terms of its time-invariant scattering transform coefficients and formulate the parametric estimation of the resonator as multidimensional regression with a deep convolutional neural network. We interpolate scattering coefficients over the surface of the drum as a surrogate for potentially missing data, and study the response of the neural network to interpolated samples. Lastly, we resynthesize drum sounds from scattering coe