Learned activation functions do seem to be a thing(https://arxiv.org/abs/1906.09529)