For frozen items you need the Campfire which can be merged from two Lit Matches.

Matches are produced from a Matchbox.

You get the Matchbox at Level 12 and an upgraded version at Level 17.

Alternatively, the Blocker Breaker (Mallet) can be used to break frozen items, but as a special item this should be used wisely.