The Not-Too-Late Show with Elmo

Elmo talks to comedian Jason Sudeikis about Kansas City and challenges him to drink a full glass of water and do a silly dance. Grover takes Mr. Johnson to see the wrong show. Ciara performs "Believe In Yourself" with Rosita, Zoe and Abby.

Elmo asks the Count to tell him when it's time to go to bed. Studio goats eat Elmo's jammies. Actress Olivia Wilde plays "Teddy Bear Dress Up" with Elmo. Musical guest Sara Bareilles and Big Bird cover "Twinkle Twinkle Little Star."

Elmo plays a guessing game with Cookie. The show's first guest, Grover, ends up on John Oliver's show by mistake so Andy Cohen replaces him and helps Elmo put away his toys. Also, Josh Groban sings a song about trash with Oscar the Grouch.

Child actress Mykal-Michelle Harris interviews Elmo and plays the "No Laugh Challenge" with him, stylist Jonathan Van Ness gives Alan from Sesame Street a monster makeover, and musical guest H.E.R. performs a song about the beauty of hair.

Elmo interviews anchorwoman Hoda Kotb and plays 'hot potato' with her and Cookie Monster, musical guest Ben Platt sings about the letter C with Cookie, and Grover turns Elmo's school backpack into a rocket backpack.

Elmo interviews comedian and TV host John Oliver and challenges him to a slow motion race. Musical guest Sofia Carson performs Hush, Little Baby. Elmo also interviews poet Kwame Alexander, who comes up, on the spot, with a poem about Elmo.

Elmo has a dream about a chicken hosting his show. Actress Blake Lively plays Cookie Monster Says with Elmo. Dan + Shay sing about why they don't want to live on the Moon. Oscar the Grouch arrives to host "Trash Talk" but there's a mix-up.

Elmo welcomes actor Miles Brown and challenges him to a fun nursery rhyme rap battle, kids from the Joyous String Ensemble play some wonderful music, and Cookie Monster babysits his adorable little niece, who causes mayhem at the studio.

Grover reports on the nighttime outside, the Sun and the Moon visit Elmo, special guest Nature Nick (of Nature Nick's Animal Adventures) brings some interesting animals, and musical guest Jordin Sparks performs Itsy Bitsy Spider.

Elmo plays a beach ball game with special guest Batman (played by uncredited actor), gets inspired by the musical guest, a capella group Pentatonix, who perform several lullabies, and then a nice bedtime story puts everyone to sleep.

Elmo and his guest, comedian John Mulaney, have a race around the studio. Elmo then performs the Elmo song with his musical guest Lil Nas X. A flock of tourist sheep touring the studio occasionally interrupt the show.

Elmo attempts a new magic trick. Burt and Ernie have technical difficulties. Special Guests: The Jonas Brothers.

Just before going to bed, Elmo hosts the premiere of his own celebrity talk show with Cookie Monster as co-host. He jokes and chats a bit with his first guest, Jimmy Fallon, and musical guest Kacey Musgraves performs for the muppets.