Baleen Visualizer

Query:
Hop:

Query + Context

At the start of each hop, the query and context are tokenized and contextualized with a BERT-based model. Queries are padded to a length of 64 with [MASK] tokens.
[CLS]
[unused0]
the
song
recorded
by
fe
##rg
##ie
that
was
produced
by
polo
##w
da
don
and
was
followed
by
life
goes
on
was
m
.
i
.
l
.
f
.
$
.
[SEP]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]

Retrieval

Each document is scored using the contextualized query. Unlike ColBERT, not every token in the query/context is used. Instead, Baleen uses focused late interaction, where only the top N most relevant query/context tokens are used for MaxSim. The score for the query and the score for the context are computed independently, and use a different number of tokens (32 for the query, 8 for the context).

27.53: M.I.L.F. $

Query Token Matches (32)
da
fe
##rg
##ie
produced
##w
[MASK]
[MASK]
don
[MASK]
polo
m
l
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
i
f
by
recorded
[MASK]
[MASK]
by
[MASK]
song
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]

27.09: Double Dutchess

Query Token Matches (32)
fe
##rg
[MASK]
##ie
[MASK]
[MASK]
life
m
[MASK]
[MASK]
on
l
i
goes
f
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
by
[MASK]
by
[MASK]
[MASK]
.
that
[MASK]
[MASK]

26.81: Life Goes On (Fergie song)

Query Token Matches (32)
##rg
##ie
life
fe
on
m
l
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
i
[MASK]
[MASK]
[MASK]
goes
[MASK]
[MASK]
f
by
by
[MASK]
recorded
[MASK]
[MASK]
[MASK]
that
song
[SEP]
[MASK]

24.28: London Bridge (Fergie song)

Query Token Matches (32)
##rg
da
fe
##ie
[MASK]
[MASK]
[MASK]
##w
polo
don
[MASK]
[MASK]
[MASK]
[MASK]
[MASK]
recorded
by
produced
[MASK]
[MASK]
[MASK]
[MASK]
that
song
[MASK]
and
by
the
was
was
[MASK]
.

Condenser (Stage 1)

The first stage reads all passages independently, then assigns a score to each sentence within the passage. The top 9 sentences across all passages ove on to the next stage.

10.48: Life Goes On (Fergie song) The song serves as the third single from Fergie's second studio album, following "M.I.L.F. $".

10.05: M.I.L.F. $ It was produced by Polow da Don and released as the second single from the record following "L.A. Love (La La)" on July 1, 2016 by Interscope and will.i.am Music Group.

5.23: M.I.L.F. $ "M.I.L.F. $" (pronounced "MILF money") is a song recorded by American singer Fergie for her second studio album, "Double Dutchess" (2017).

3.37: Life Goes On (Fergie song) "Life Goes On" is a song recorded by American singer Fergie for her second studio album, "Double Dutchess" (2017).

-0.79: Life Goes On (Fergie song) "Life Goes On" was written by Fergie, Tristan Prettyman, Keith Harris and Toby Gad.

-3.11: Life Goes On (Fergie song) It was released as single on November 11, 2016, by Interscope and will.i.am Music Group.

-3.81: M.I.L.F. $ It debuted at number 34 on the US "Billboard" Hot 100 with 65,000 in first-week sales.

-7.08: Double Dutchess M.I.L.F. $" was released as the second single from the album in July 2016, followed by the release of "Life Goes On" in November that same year. "

-8.51: London Bridge (Fergie song) "London Bridge" is a song recorded by American singer and rapper Fergie for her debut studio album, "The Dutchess" (2006).

Condenser (Stage 2)

The second stage reads all sentences from the previous stage at once, then rescores all sentences. All positive passages move on.

8.17: Life Goes On (Fergie song) The song serves as the third single from Fergie's second studio album, following "M.I.L.F. $".

6.70: M.I.L.F. $ It was produced by Polow da Don and released as the second single from the record following "L.A. Love (La La)" on July 1, 2016 by Interscope and will.i.am Music Group.

5.36: M.I.L.F. $ "M.I.L.F. $" (pronounced "MILF money") is a song recorded by American singer Fergie for her second studio album, "Double Dutchess" (2017).

-7.71: Life Goes On (Fergie song) "Life Goes On" is a song recorded by American singer Fergie for her second studio album, "Double Dutchess" (2017).

-8.46: London Bridge (Fergie song) "London Bridge" is a song recorded by American singer and rapper Fergie for her debut studio album, "The Dutchess" (2006).

-8.64: Double Dutchess M.I.L.F. $" was released as the second single from the album in July 2016, followed by the release of "Life Goes On" in November that same year. "

-8.71: Life Goes On (Fergie song) It was released as single on November 11, 2016, by Interscope and will.i.am Music Group.

-8.87: Life Goes On (Fergie song) "Life Goes On" was written by Fergie, Tristan Prettyman, Keith Harris and Toby Gad.

-8.99: M.I.L.F. $ It debuted at number 34 on the US "Billboard" Hot 100 with 65,000 in first-week sales.

New Context

The context for the next hop consists of the facts produced by the previous stage. If this is the final hop, the query and context are passed to the reader for answering.

Life Goes On (Fergie song) The song serves as the third single from Fergie's second studio album, following "M.I.L.F. $".

M.I.L.F. $ It was produced by Polow da Don and released as the second single from the record following "L.A. Love (La La)" on July 1, 2016 by Interscope and will.i.am Music Group.

M.I.L.F. $ "M.I.L.F. $" (pronounced "MILF money") is a song recorded by American singer Fergie for her second studio album, "Double Dutchess" (2017).