I got a kitten, but it's driving me nuts?

They do that. He's only a baby. He'll start to get more independent in the coming weeks and be more of a troublemaker than you can imagine. Enjoy the cuddles while you can before the breakages start. Mate of mine's 10 week old kittens managed to turn the gas hob on in the kitchen and it was only luck that the house wasn't blown to bits.