Vision Transformers for industrial applications

Vision Transformers (ViT) are very powerful deep architectures capable of recognizing and using very subtle statistical patterns, often invisible to humans. Nice but... to achieve these performances they require having large databases, well maintained and representative of the domain of interest, perhaps even i.i.d.. This usually only happens in paper-academic contexts or technological superpowers. But fortunately (for you) in this seminar we will show how it is possible to profitably use ViTs in real low-budget industrial contexts where the raw material (i.e. data) is few, dirty and often ugly.