Looking for a book title

I am trying to find a book that I enjoyed as a child but I cannot remember the name or the author.

I read the book around 1991, so the book is probably from the 1980's or even the 70's.

It is about a young boy who visits his grandparents in the English countryside for the summer and his grandfather introduces him to a family of Gypsies who live in a field nearby. I can't remember if they are Irish or Roma gypsy.

The gypsy teaches the boy all sorts, and tells him stories with his grandfather. At the end of the story, the boys parents come to collect him.

I think one of the characters may have been called Dilys. Inside the book had a number of illustrations, seemed to be fine pen or pencil, rough sketch style.

I thought the book was called "Travelers Tales" but when I look for that, nothing comes up that is ringing any bells for me.

Unfortunately I don't remember much more.
Hopefully someone can help!