What is the difference between deep neural networks and traditional neural networks

It's obvious from the name, one word, deep

Deep networks have now reached thousands of layers or even tens of thousands of layers of depth, and with that comes billions of model parameters

What you call traditional neural networks probably means MLPs, RBFs, and these ancient networks that are a few layers deep