I might use that phrase in informal speech, but not in writing anything more formal than an e-mail to a friend.
You might be interested in the discussion of
firstly in
this WRF thread. There are many others. You can find a list by searching for "firstly" in the dictionary box at the top of this page.
What's wrong with "first?"