What do you fill driveway expansion joints with?

Well, it’s called “expansion joint material”.

It is basically felt that has been soaked in asphalt and left to dry. There are also some foam products as well.