He only wants me to help him

My Dad (a widower and living alone since 2001) was diagnosed with dementia approx 2 months ago - although I have known there was a problem for at least 2 years. The geriatric specialist took away his license on the spot and we are awaiting an MR in about 3 weeks. I have one brother who lives on the opposite side of the country who is therefore unable to help. My daughter does what she can but also lives out of town. The last two years have been challenge enough but now that Dad has lost his independence, the task has increased immensely. In the last 3 weeks my husband has volunteered to take Dad out one day a week to do whatever errands he might need and fit in a coffee if time allows. It was an enormous help! And it allowed for more and different stimulation. However, my Dad announced last night that he want ONLY ME to take him places - that he knows my husband means well - but insists that it has to be me. He will not allow any agencies to come in nor will he allow any Meals on Wheels. When approached on that possibility he accused me of not wanting to take care of him anymore. I know that he only eats well when I make it for him and sadly he has no friends. It has become extremely stressful and demanding and I foresee it becoming even more so as his disease progresses. Any advice would be most appreciated.