Photo: ABC Photo Archives/Disney/Getty

Family Matters

Family MattersstarReginald VelJohnsonhas a bit of personal experience with that old showbiz adage “never work with children or animals.”

VelJohnson, who played Carl Winslow on the ABC series from 1989 to 1997, opened up on Tuesday about his frustration — and fondness — for his young costars.

“He was a wonderful kid, [but] I think working with him was a challenge,” the actor, 69, toldEntertainment Tonight.

He acknowledged, “Working with everybody was a challenge, and there were some moments where he was a little difficult. But overall, I have nothing but good memories from him.”

Jaleel White.Bob D’Amico/Walt Disney Television via Getty

Jaleel White

VelJohnson noted, “I think, you know, a lot of the kids grew up on the set and we had to deal with children … and that was an interesting experience, dealing with children as they grew up.”

Sometimes, the kid actors' antic even drove him into hiding: “I went to my dressing room and locked the door when I [rehearsed] my scenes because that was the only way. Because kids have a lot of energy … [and] you couldn’t deal with it.”

On another occasion, he recalled, “[Jaleel and] the kids were playing basketball on the set, and I just couldn’t take it. I said, ‘Please, please stop the basketball!’ And they wouldn’t stop.”

VelJohnson continued, “I said, ‘Listen, you either stop the basketball playing or I’m gonna leave.’ And I left. But there was no more basketball after that.”

Emily Assiran/Contour/Getty

90’s Con Portrait Studio

But theDie Hardactor had nothing but kind words to say aboutJoMarie Payton, who played his onscreen wife Harriette.

“I just fell in love with her the first time I saw her, I really did,” he said.

He continued, “I think that she’s a special lady, you know, and that’s how I approached the role. Because she was the best to work with.”

“We never had arguments or anything on the set. he added. Never. Not once, not ever,” he said. “I really appreciate that because I made sure that our relationship on the set and off the set was gonna be a good one.”

Never miss a story — sign up forPEOPLE’s free daily newsletterto stay up-to-date on the best of what PEOPLE has to offer, from juicy celebrity news to compelling human interest stories.

All nine seasons ofFamily Matterscan be streamed now on HBO Max.

source: people.com