Yeah the angles need a bit of working on. I find when filming skate vids it works to follow the skater along (obviously not in a pool though) behind them on a skateboard too, from a very low, near ground angle. Fisheye lens works a treat too.
A thing that works great in skate vids is when you have a fixed angle the skater can come into and come out of, like at the top of a qp or something.
With a handheld it can be cool to use a makeshift frame from a pole and a hook, you could try that out. It works well for going from above the skater as they come up a qp to them at the top of it.