This area takes its name from the Sceriman or Seriman family, a rich Spanish family forced to move to Italy to flee persecution in Spain. Many representatives of the family joined the ecclesiastic orders, reaching the rightest ranks, while others joined the Austro-Hungarian army. They were also active in the cause of the Venetian Republic, lending money during the costly and arduous War of Candia. This area was the site of one of their homes, which had previously belonged to the Gozzi family (which gave its name to the Rio onto which the palazzo looks).

The wall of the bridge leading to Campo dei Gesuiti bears a sculpture of the Madonna wearing a crown and the coat of arms of the Scuola della Carità engraved on her breast.