For something to be broken does there have to be swelling?

my foot hurts really bad about where my foot and second toe meet. There is no swelling. Right now I made crutches out of two brooms because it hurts to walk.