the problem with GPUs is the same - really only applicable to graphics and now since a few years AI, shoehorned into something which was never meant to deal with AI workloads. meanwhile nothing has been done to increase the number of cores, which is really important to be able to run a wider variety of computationally intensive applications on embedded/mobile devices. what most SoC companies are doing is simply slapping on a variety of irrelevant peripherals instead of focusing on what's important - more cores.