In December 2010, Big Boi, one half of famed hip hop duo OutKast, accidentally discovered Phantogram, an electronic rock duo consisting of Josh Carter and Sarah Barthel, when hearing their single "Mouthful of Diamonds" in a pop-up ad. Big Boi shared the song on his website as the "Jam of the Week". Barthel saw the post and contacted Big Boi, which led to future collaborations. Big Boi's 2012 studio album Vicious Lies and Dangerous Rumors, included three tracks featuring Phantogram: "Objectum Sexuality", "CPU" and "Lines", and in a interview days before its December 11 release, Big Boi revealed that he and Phantogram were planning to record a "one-off EP type of thing" titled Big Grams.

Carter described the project's sound as "sort of" "psyched-out hip-hop". Barthel and Big Boi provided sung vocals and rapped vocals respectively, while Carter only occasionally provided vocals and was the project's primary producer.