There's not a whole lot of respect or love coming from this man...are you happy to just receive his crumbs because the chances of it getting any better are very slim!!
Your not a priority and doesn't sound like you ever will be and the way he is treating you has red flags all over it!!
Your choice though, you obviously don't feel you deserve better!