looks like the initial scuffle began after VL #71 was blocking HU #8 (or perhaps #9, I can't tell) and sustained the block after the ballcarrier was well by and the pair were off the field and onto the track. The Howard player had grabbed onto the VL player as well, but then they both went out of frame (as the camera was following the ballcarrier)
Those sort of scuffles aren't uncommon, but then it looks like a number of VL bench players ran across the field from their (opposite) sideline and things started escalating.

side note/question: Is Howard one of those schools whose marching band is well known? (I don't really follow marching bands), and if so were they still able to do their "halftime show" even if the football game was ended early because of the fight?