I seem to have hit a wall during week 3 and 4, moving into week 5 now and I hope to see pounds drop this week and the coming weeks. However, I am really scared that things aren't moving forward the way they should.
Yep - it's perfectly normal. You'll experience several of these plateaus on your way down. Your body just needs a chance to re-check its bearings. You'll start up again before you know it.