thomaskim1130's picture
Upload folder using huggingface_hub
f10dfc9 verified
metadata
tags:
  - sentence-transformers
  - sentence-similarity
  - feature-extraction
  - generated_from_trainer
  - dataset_size:2256
  - loss:MultipleNegativesRankingLoss
base_model: dunzhang/stella_en_400M_v5
widget:
  - source_sentence: >-
      Instruct: Given a web search query, retrieve relevant passages that answer
      the query.

      Query: Title: 

      Text: by what percentage did the aeco natural gas sales index decline from
      2011 to 2013?
    sentences:
      - >-
        Title: 

        Text: |  | 2017 | 2016 |

        | Projected benefit obligation | $74,953 | $76,586 |

        | Accumulated benefit obligation | 71,975 | 74,081 |

        | Fair value of plan assets | $58,353 | $56,530 |

        Assumptions The following assumptions, which are the weighted average
        for all plans, are used to calculate the benefit obligation at December
        31 of each year and the net periodic benefit cost for the subsequent
        year.
      - >-
        Title: 

        Text: discount to Brent was narrower in 2013 than in 2012 and 2011.

        As a result of the significant increase in U. S.  production of light
        sweet crude oil, the historical relationship between WTI, Brent and LLS
        pricing may not be indicative of future periods.

        Composition  The proportion of our liquid hydrocarbon sales volumes
        that are NGLs continues to increase due to our development of United
        States unconventional liquids-rich plays.

        NGLs were 15 percent of our North America E&P liquid hydrocarbon sales
        volumes in 2013 compared to 10 percent in 2012 and 7 percent in 2011.

        Natural gas  A significant portion of our natural gas production in the
        U. S.  is sold at bid-week prices, or first-of-month indices relative to
        our specific producing areas.

        Average Henry Hub settlement prices for natural gas were 31 percent
        higher for 2013 than for 2012.  International E&P Liquid hydrocarbons 
        Our International E&P crude oil production is relatively sweet and has
        historically sold in relation to the Brent crude benchmark, which on
        average was 3 percent lower for 2013 than 2012.

        Natural gas  Our major International E&P natural gas-producing regions
        are Europe and E. G.  Natural gas prices in Europe have been
        considerably higher than the U. S.  in recent years.

        In the case of E. G. , our natural gas sales are subject to term
        contracts, making realized prices in these areas less volatile.

        The natural gas sales from E. G.  are at fixed prices; therefore, our
        reported average International E&P natural gas realized prices may not
        fully track market price movements.
      - >-
        Title: 

        Text: american tower corporation and subsidiaries notes to consolidated
        financial statements towerco ghana for an agreed purchase price of up to
        approximately $ 430 million , of which the company will pay up to
        approximately $ 220 million for its 51% ( 51 % ) stake in the holding
        company .

        mtn ghana will be the anchor tenant , on commercial terms , on each of
        the towers being purchased .

        the company also expects that towerco ghana will build at least an
        additional 400 sites for both mtn ghana and other wireless operators in
        ghana over the next five years .

        the company expects to close on an initial tranche of towers in the
        first half of 2011 , subject to customary closing conditions .

        6 .

        long-term obligations outstanding amounts under the company 2019s
        long-term financing arrangements consist of the following as of december
        31 , ( in thousands ) : .

                                                                    | 2010             | 2009            
        ----------------------------------------------------------- |
        ---------------- | ----------------

        commercial mortgage pass-through certificates series 2007-1 | $
        1750000        | $ 1750000       

        revolving credit facility                                   |
        300000           | 550000          

        term loan                                                   |
        325000           | 325000          

        xcel credit facility                                        |
        2014             | 73367           

        colombian short-term credit facility                        |
        72889            | 2014            

        4.50% ( 4.50 % ) senior notes                               |
        999216           | 2014            

        5.05% ( 5.05 % ) senior notes                               |
        699186           | 2014            

        4.625% ( 4.625 % ) senior notes                             |
        599346           | 599210          

        7.00% ( 7.00 % ) senior notes                               |
        500000           | 500000          

        7.25% ( 7.25 % ) senior notes                               |
        295420           | 295038          

        5.0% ( 5.0 % ) convertible notes                            |
        2014             | 59683           

        7.25% ( 7.25 % ) senior subordinated notes                  |
        2014             | 288             

        notes payable and capital leases                            |
        46331            | 58995           

        total                                                       |
        5587388          | 4211581         

        less current portion of long term obligations               | -74896 (
        74896 ) | -70521 ( 70521 )

        long-term obligations                                       | $
        5512492        | $ 4141060       


        commercial mortgage pass-through certificates , series 2007-1 2014during
        the year ended december 31 , 2007 , the company completed a
        securitization transaction ( the 201csecuritization 201d ) involving
        assets related to 5295 broadcast and wireless communications towers (
        the 201csecured towers 201d ) owned by two special purpose subsidiaries
        of the company , through a private offering of $ 1.75 billion of
        commercial mortgage pass-through certificates , series 2007-1 ( the
        201ccertificates 201d ) .

        the certificates were issued by american tower trust i ( the trust ) , a
        trust established by american tower depositor sub , llc ( the
        201cdepositor 201d ) , an indirect wholly owned special purpose
        subsidiary of the company .

        the assets of the trust consist of a recourse loan ( the 201cloan 201d )
        initially made by the depositor to american tower asset sub , llc and
        american tower asset sub ii , llc ( the 201cborrowers 201d ) , pursuant
        to a loan and security agreement among the foregoing parties dated as of
        may 4 , 2007 ( the 201cloan agreement 201d ) .

        the borrowers are special purpose entities formed solely for the purpose
        of holding the secured towers subject to the securitization .

        the certificates were issued in seven separate classes , comprised of
        class a-fx , class a-fl , class b , class c , class d , class e and
        class f .

        each of the certificates in classes b , c , d , e and f are subordinated
        in right of payment to any other class of certificates which has an
        earlier alphabetical designation .

        the certificates were issued with terms identical to the loan except for
        the class a-fl certificates , which bear interest at a floating 
  - source_sentence: >-
      Instruct: Given a web search query, retrieve relevant passages that answer
      the query.

      Query: Title: 

      Text: In the year with lowest amount of Interest in table 2, what's the
      increasing rate of Operating leases in table 2?
    sentences:
      - >-
        Title: 

        Text: Management Discussion and Analysis

        Associates

        "nm" denotes not meaningful.

        Notes: (1) Based on Singapore Financial Reporting Standards
        (International).

        (2) Assuming constant exchange rates for the regional currencies (Indian
        Rupee, Indonesian Rupiah, Philippine Peso and Thai Baht) from FY 2018.

        (3) Share of results excluded the Group’s share of the associates’
        significant one-off items which have been classified as exceptional
        items of the Group.

        (4) Singtel holds an equity interest of 21.0% in Intouch which has an
        equity interest of 40.5% in AIS.

        (5) Bharti Telecom Limited (BTL) holds an equity interest of 50.1% in
        Airtel as at 31 March 2019. In BTL’s standalone books, its loss
        comprised mainly interest charges on its borrowings.

        (5) Bharti Telecom Limited (BTL) holds an equity interest of 50.1% in
        Airtel as at 31 March 2019. In BTL’s standalone books, its loss
        comprised mainly interest charges on its borrowings.

        (6) Singtel ceased to own units in NetLink Trust following the sale to
        NetLink NBN Trust in July 2017 but continues to have an interest of
        24.8% in NetLink NBN Trust, the holding company of NetLink Trust. The
        share of results included Singtel’s amortisation of deferred gain of
        S$20 million (FY 2018: S$32 million) on assets previously transferred to
        NetLink Trust, but excluded the fair value adjustments recorded by
        NetLink NBN Trust in respect of its acquisition of units in NetLink
        Trust.

        (7) Include the share of results of Singapore Post Limited.

                                                       | Financial Year ended 31 March |              |        |                                
        ---------------------------------------------- |
        ----------------------------- | ------------ | ------ |
        -------------------------------
                                                       | 2019                          | 2018         | Change | Change in constant currency (2)
                                                       | (S$ million)                  | (S$ million) | (%)    | (%)                            
        Group share of associates' pre-tax profits (3)  |
        1,536                         | 2,461        | -37.6  |
        -36.2                          

        Share of post-tax profits                      
        |                               |              |       
        |                                

        Telkomsel                                      |
        843                           | 1,031        | -18.3  |
        -12.4                          

        AIS                                            |
        286                           | 292          | -1.7   |
        -3.9                           

        Globe (3)                                     
        |                               |              |       
        |                                

        - ordinary results                             |
        251                           | 180          | 39.3   |
        45.3                           

        - exceptional items                            |
        -                             | 22           | nm     |
        nm                             
                                                       | 251                           | 202          | 23.9   | 29.1                           
        Intouch (3) (4)                               
        |                               |              |       
        |                                

        - operating results                            |
        101                           | 106          | -4.4   |
        -6.5                           

        - amortisation of acquired intangibles         |
        (22)                          | (21)         | 8.3    |
        5.9                            
                                                       | 79                            | 86           | -7.5   | -9.5                           
        Airtel (3)                                     |
        (131)                         | 101          | nm     |
        nm                             

        BTL (5)                                        |
        (40)                          | (18)         | 127.8  |
        140.9                          
                                                       | (171)                         | 83           | nm     | nm                             
        Regional associates (3)                        |
        1,287                         | 1,694        | -24.0  |
        -21.5                          

        NetLink NBN Trust/ NetLink Trust (6)           |
        48                            | 72           | -32.9  |
        -32.9                          

        Other associates (3) (7)                       |
        47                            | 57           | -17.6  |
        -17.6                          

        Group share of associates’ post-tax profits (3) |
        1,383                         | 1,823        | -24.1  |
        -21.8                          
      - >-
        Title: 

        Text: Long-term product offerings include alpha-seeking active and index
        strategies.

        Our alpha-seeking active strategies seek to earn attractive returns in
        excess of a market benchmark or performance hurdle while maintaining an
        appropriate risk profile, and leverage fundamental research and
        quantitative models to drive portfolio construction.

        In contrast, index strategies seek to closely track the returns of a
        corresponding index, generally by investing in substantially the same
        underlying securities within the index or in a subset of those
        securities selected to approximate a similar risk and return profile of
        the index.

        Index strategies include both our non-ETF index products and iShares
        ETFs.

        Although many clients use both alpha-seeking active and index
        strategies, the application of these strategies may differ.

        For example, clients may use index products to gain exposure to a market
        or asset class, or may use a combination of index strategies to target
        active returns.

        In addition, institutional non-ETF index assignments tend to be very
        large (multi-billion dollars) and typically reflect low fee rates.

        Net flows in institutional index products generally have a small impact
        on BlackRock’s revenues and earnings.

        Equity Year-end 2017 equity AUM totaled $3.372 trillion, reflecting net
        inflows of $130.1 billion.

        Net inflows included $174.4 billion into iShares ETFs, driven by net
        inflows into Core funds and broad developed and emerging market
        equities, partially offset by non-ETF index and active net outflows of
        $25.7 billion and $18.5 billion, respectively.

        BlackRock’s effective fee rates fluctuate due to changes in AUM mix.

        Approximately half of BlackRock’s equity AUM is tied to international
        markets, including emerging markets, which tend to have higher fee rates
        than U. S.  equity strategies.

        Accordingly, fluctuations in international equity markets, which may not
        consistently move in tandem with U. S.  markets, have a greater impact
        on BlackRock’s equity revenues and effective fee rate.

        Fixed Income Fixed income AUM ended 2017 at $1.855 trillion, reflecting
        net inflows of $178.8 billion.

        In 2017, active net inflows of $21.5 billion were diversified across
        fixed income offerings, and included strong inflows into municipal,
        unconstrained and total return bond funds.

        iShares ETFs net inflows of $67.5 billion were led by flows into Core,
        corporate and treasury bond funds.

        Non-ETF index net inflows of $89.8 billion were driven by demand for
        liability-driven investment solutions.

        Multi-Asset BlackRock’s multi-asset team manages a variety of balanced
        funds and bespoke mandates for a diversified client base that leverages
        our broad investment expertise in global equities, bonds, currencies and
        commodities, and our extensive risk management capabilities.

        Investment solutions might include a combination of long-only portfolios
        and alternative investments as well as tactical asset allocation
        overlays.

        Component changes in multi-asset AUM for 2017 are presented below.
      - >-
        Title: PEPSICO_2022_10K

        Text: Forward-Looking Statements

        This Annual Report on Form 10-K contains statements reflecting our views
        about our future performance that constitute

        forward-looking statements within the meaning of the Private Securities
        Litigation Reform Act of 1995 (Reform Act).

        Statements that constitute forward-looking statements within the meaning
        of the Reform Act are generally identified through the

        inclusion of words such as aim, anticipate, believe, drive, estimate,
        expect, expressed confidence, forecast,

        future, goal, guidance, intend, may, objective, outlook, plan, position,
        potential, project, seek,

        should, strategy, target, will or similar statements or variations of
        such words and other similar expressions. All

        statements addressing our future operating performance, and statements
        addressing events and developments that we expect or

        anticipate will occur in the future, are forward-looking statements
        within the meaning of the Reform Act. These forward-looking

        statements are based on currently available information, operating plans
        and projections about future events and trends. They

        inherently involve risks and uncertainties that could cause actual
        results to differ materially from those predicted in any such

        forward-looking statement. These risks and uncertainties include, but
        are not limited to, those described in Item 1A. Risk

        Factors and Item 7. Managements Discussion and Analysis of Financial
        Condition and Results of Operations Our Business
         Our Business Risks. Investors are cautioned not to place undue reliance on any such forward-looking statements, which speak
        only as of the date they are made. We undertake no obligation to update
        any forward-looking statement, whether as a result of

        new information, future events or otherwise. The discussion of risks in
        this report is by no means all-inclusive but is designed to

        highlight what we believe are important factors to consider when
        evaluating our future performance.

        PART I

        Item 1. Business.

        When used in this report, the terms we, us, our, PepsiCo and the Company
        mean PepsiCo, Inc. and its consolidated

        subsidiaries, collectively. Certain terms used in this Annual Report on
        Form 10-K are defined in the Glossary included in Item 7.

        of this report.

        Company Overview

        We were incorporated in Delaware in 1919 and reincorporated in North
        Carolina in 1986. We are a leading global beverage and

        convenient food company with a complementary portfolio of brands,
        including Lays, Doritos, Cheetos, Gatorade, Pepsi-Cola,

        Mountain Dew, Quaker and SodaStream. Through our operations, authorized
        bottlers, contract manufacturers and other third

        parties, we make, market, distribute and sell a wide variety of
        beverages and convenient foods, serving customers and consumers

        in more than 200 countries and territories.

        Our Operations

        We are organized into seven reportable segments (also referred to as
        divisions), as follows:

        1) Frito-Lay North America (FLNA), which includes our branded convenient
        food businesses in the United States and

        Canada;

        2) Quaker Foods North America (QFNA), which includes our branded
        convenient food businesses, such as cereal, rice, pasta

        and other branded food, in the United States and Canada;

        3) PepsiCo Beverages North America (PBNA), which includes our beverage
        businesses in the United States and Canada;

        4) Latin America (LatAm), which includes all of our beverage and
        convenient food businesses in Latin America;

        5) Europe, which includes all of our beverage and convenient food
        businesses in Europe;
  - source_sentence: >-
      Instruct: Given a web search query, retrieve relevant passages that answer
      the query.

      Query: Title: 

      Text: What was the rate of compensation increase in 2019?
    sentences:
      - >-
        Title: 

        Text: Assumptions

        Weighted-average actuarial assumptions used to determine net periodic
        benefit cost and projected benefit obligation for the plans for the
        fiscal years 2019, 2018 and 2017 were as follows:

        (1) The expected return on plan assets assumption used in calculating
        net periodic benefit cost is based on historical return experience and
        estimates of future long-term performance with consideration to the
        expected investment mix of the plan.

        (2) The discount rate is used to state expected cash flows relating to
        future benefits at a present value on the measurement date. This rate
        represents the market rate for high-quality fixed income investments
        whose timing would match the cash outflow of retirement benefits. Other
        assumptions include demographic factors such as retirement, mortality
        and turnover.

                                                    |      | Pension |     
        ------------------------------------------- | ---- | ------- | ----
                                                    | 2019 | 2018    | 2017
        Net periodic benefit cost:                  |      |         |     

        Expected long-term return on plan assets(1) | 3.6% | 3.8%    | 3.3%

        Rate of compensation increase               | 4.4% | 3.3%    | 2.7%

        Discount rate                               | 2.2% | 2.1%    | 1.9%

        Projected benefit obligation:               |      |         |     

        Expected long-term return on plan assets    | 2.0% | 3.6%    | 4.0%

        Rate of compensation increase               | 4.3% | 4.4%    | 4.4%

        Discount rate(2)                            | 1.7% | 2.2%    | 2.3%
      - >-
        Title: 

        Text: decentralized business model .

        our business segments are focused on distinct product categories and are
        responsible for their own performance .

        this structure enables each of our segments to independently best
        position itself within each category in which it competes and reinforces
        strong accountability for operational and financial performance .

        each of our segments focuses on its unique set of consumers , customers
        , competitors and suppliers , while also sharing best practices .

        strong capital structure .

        we exited 2017 with a strong balance sheet .

        in 2017 , we repurchased 3.4 million of our shares .

        as of december 31 , 2017 , we had $ 323.0 million of cash and cash
        equivalents and total debt was $ 1507.6 million , resulting in a net
        debt position of $ 1184.6 million .

        in addition , we had $ 635.0 million available under our credit facility
        as of december 31 , 2017 .

        business segments we have four business segments : cabinets , plumbing ,
        doors and security .

        the following table shows net sales for each of these segments and key
        brands within each segment : segment net sales ( in millions )
        percentage of total 2017 net sales key brands cabinets $ 2467.1 47% ( 47
        % ) aristokraft , diamond , mid-continent , kitchen craft , schrock ,
        homecrest , omega , thomasville ( a ) , kemper , starmark , ultracraft
        plumbing 1720.8 33% ( 33 % ) moen , rohl , riobel , perrin & rowe ,
        victoria + albert , shaws , waste king .


        segment  | 2017net sales ( in millions ) | percentage of total 2017 net
        sales | key
        brands                                                                                                        

        -------- | ----------------------------- |
        ---------------------------------- |
        ------------------------------------------------------------------------------------------------------------------

        cabinets | $ 2467.1                      | 47% ( 47 %
        )                       | aristokraft diamondmid-continentkitchen craft
        schrock homecrest omega thomasville ( a ) kemper starmark ultracraft

        plumbing | 1720.8                        | 33% ( 33 %
        )                       | moen rohl riobel perrin & rowe victoria +
        albert shaws waste king                                                 

        doors    | 502.9                         | 9% ( 9 %
        )                         |
        therma-trufypon                                                                                                   

        security | 592.5                         | 11% ( 11 %
        )                       | master lock american lock
        sentrysafe                                                                              

        total    | $ 5283.3                      | 100% ( 100 %
        )                    
        |                                                                                                                   


        ( a ) thomasville is a registered trademark of hhg global designs llc .

        our segments compete on the basis of innovation , fashion , quality ,
        price , service and responsiveness to distributor , retailer and
        installer needs , as well as end-user consumer preferences .

        our markets are very competitive .

        approximately 15% ( 15 % ) of 2017 net sales were to international
        markets , and sales to two of the company 2019s customers , the home
        depot , inc .

        ( 201cthe home depot 201d ) and lowe 2019s companies , inc .

        ( 201clowe 2019s 201d ) , each accounted for more than 10% ( 10 % ) of
        the company 2019s net sales in 2017 .

        sales to all u.s .

        home centers in the aggregate were approximately 27% ( 27 % ) of net
        sales in 2017 .

        cabinets .

        our cabinets segment manufactures custom , semi-custom and stock
        cabinetry , as well as vanities , for the kitchen , bath and other parts
        of the home through a regional supply chain footprint to deliver high
        quality and service to our customers .

        this segment sells a portfolio of brands that enables our customers to
        differentiate themselves against competitors .

        this portfolio includes brand names such as aristokraft , diamond ,
        mid-continent , kitchen craft , schrock , homecrest , omega ,
        thomasville , kemper , starmark and ultracraft .

        substantially all of this segment 2019s sales are in north america .

        this segment sells directly to kitchen and bath dealers , home centers ,
        wholesalers and large builders .

        in aggregate , sales to the home depot and lowe 2019s comprised
        approximately 34% ( 34 % ) of net sales of the cabinets segment in 2017
        .

        this segment 2019s competitors include masco , american woodmark and rsi
        ( owned by american woodmark ) , as well as a large number of regional
        and local suppliers .

        plumbing .

        our plumbing segment manufactures or assembles and sells faucets ,
        accessories , kitchen sinks and waste disposals in north america and
        china , predominantly under the moen , rohl , riobel , perrin & rowe ,
        victoria + albert , shaws and waste king brands .

        although this segment sells products principally in the u.s. , canada
        and china , this segment also sells in mexico , southeast asia , europe
        and 
      - >-
        Title: 

        Text: Performance Graph The annual changes for the period shown December
        1, 2013 (when our ordinary shares began trading) to December 31, 2017 in
        the graph on this page are based on the assumption that $100 had been
        invested in Allegion plc ordinary shares, the Standard & Poor’s 500
        Stock Index ("S&P 500") and the Standard & Poor's 400 Capital Goods
        Index ("S&P 400 Capital Goods") on December 1, 2013, and that all
        quarterly dividends were reinvested.

        The total cumulative dollar returns shown on the graph represent the
        value that such investments would have had on December 31, 2017.
  - source_sentence: >-
      Instruct: Given a web search query, retrieve relevant passages that answer
      the query.

      Query: Title: 

      Text: In which years is Other comprehensive income before
      reclassifications greater than Net current-period other comprehensive
      income (for Changes related to cash flow derivative hedges)?
    sentences:
      - >-
        Title: 

        Text: NOTE 5.

        PROPERTY AND EQUIPMENT Property and equipment consists of the following
        (in thousands):

        |  | 2015 | 2014 |

        | Ships | $22,102,025 | $21,620,336 |

        | Ship improvements | 2,019,294 | 1,904,524 |

        | Ships under construction | 734,998 | 561,779 |

        | Land, buildings and improvements, including leasehold improvements and
        port facilities | 337,109 | 303,394 |

        | Computer hardware and software, transportation equipment and other |
        1,025,264 | 889,579 |

        | Total property and equipment | 26,218,690 | 25,279,612 |

        | Less—accumulated depreciation and amortization | -7,440,912 |
        -7,085,985 |

        |  | $18,777,778 | $18,193,627 |

        Ships under construction include progress payments for the construction
        of new ships as well as planning, design, interest and other associated
        costs.

        We capitalized interest costs of $26.5 million, $28.8 million and $17.9
        million for the years 2015, 2014 and 2013, respectively.

        We review our long-lived assets for impairment whenever events or
        changes in circumstances indicate potential impairment.

        In conjunction with performing the two-step goodwill impairment test for
        the Pullmantur reporting unit, we identified that the estimated fair
        value of certain long-lived assets, consisting of two ships and three
        aircraft were less than their carrying values.

        As a result of this determination, we evaluated these assets pursuant to
        our long-lived asset impairment test.

        The decision to significantly reduce our exposure to the Latin American
        market negatively impacted the expected undiscounted cash flows of these
        vessels and aircraft and resulted in an impairment charge of $113.2
        million to write down these assets to their estimated fair values.

        This impairment charge was recognized in earnings during the third
        quarter of 2015 and is reported within Impairment of Pullmantur related
        assets within our consolidated statements of comprehensive income
        (loss).

        Additionally, during 2013, the fair value of Pullmantur’s aircraft were
        determined to be less than their carrying value which led to a
        restructuring related impairment charge of $13.5 million.

        Furthermore, Pullmantur’s non-core businesses met the accounting
        criteria to be classified as held for sale during the fourth quarter of
        2013 which led to restructuring related impairment charges of $18.2
        million to adjust the carrying value of property and equipment held for
        sale to its fair value, less cost to sell.

        These impairment charges were reported within Restructuring and related
        impairment charges in our consolidated statements of comprehensive
        income (loss).

        Notes to the Consolidated Financial Statements << 84 >> | 2015 ANNUAL
        REPORT NOTE 13.

        CHANGES IN ACCUMULATED OTHER COMPREHENSIVE INCOME (LOSS) The following
        table presents the changes in accumulated other comprehensive income
        (loss) by component for the years ended December 31, 2015 and 2014 (in
        thousands):

        |  | Changes related to cash flow derivative hedges | Changes in
        definedbenefit plans | Foreign currency translation adjustments |
        Accumulated other comprehensive income (loss) |

        | Accumulated comprehensive loss at January 1, 2013 | $-84,505 |
        $-34,823 | $-15,188 | $-134,516 |

        | Other comprehensive income before reclassifications | 188,073 | 8,240
        | 1,529 | 197,842 |

        | Amounts reclassified from accumulated other comprehensive income
        (loss) | -60,244 | 2,589 |  | -57,655 |

        | Net current-period other comprehensive income | 127,829 | 10,829 |
        1,529 | 140,187 |

        | Accumulated comprehensive income (loss) at January 1, 2014 | 43,324 |
        -23,994 | -13,659 | 5,671 |

        | Other comprehensive loss before reclassifications | -919,094 | -8,937
        | -28,099 | -956,130 |

        | Amounts reclassified from accumulated other comprehensive income
        (loss) | 49,744 | 1,724 | 1,997 | 53,465 |

        | Net current-period other comprehensive loss | -869,350 | -7,213 |
        -26,102 | -902,665 |

        | Accumulated comprehensive loss at January 1, 2015 | -826,026 | -31,207
        | -39,761 | -896,994 |

        | Other comprehensive (loss) income before reclassifications | -697,671
        | 3,053 | -25,952 | -720,570 |

        | Amounts reclassified from accumulated other comprehensive income
        (loss) | 291,624 | 1,707 | -4,200 | 289,131 |

        | Net current-period other comprehensive (loss) income | -406,047 |
        4,760 | -30,152 | -431,439 |

        | Accumulated comprehensive loss at December 31, 2015 | $-1,232,073 |
        $-26,447 | $-69,913 | $-1,328,433 |

        The following table presents reclassifications out of accumulated other
        comprehensive income (loss) for the years ended December 31, 2015 and
        2014 (in thousands):
      - >-
        Title: 

        Text: defined contribution plan the company and certain subsidiaries
        have various defined contribution plans , in which all eligible
        employees may participate .

        in the u.s. , the 401 ( k ) plan is a contributory plan .

        matching contributions are based upon the amount of the employees 2019
        contributions .

        after temporarily suspending all matching contributions , effective july
        1 , 2010 , the company reinstated matching contributions and provides a
        dollar for dollar ( 100% ( 100 % ) ) match on the first 4% ( 4 % ) of
        employee contributions .

        the maximum matching contribution for 2010 was pro-rated to account for
        the number of months remaining after the reinstatement .

        the company 2019s expenses for material defined contribution plans for
        the years ended december 31 , 2012 , 2011 and 2010 were $ 42 million , $
        48 million and $ 23 million , respectively .

        beginning january 1 , 2012 , the company may make an additional
        discretionary 401 ( k ) plan matching contribution to eligible employees
        .

        for the year ended december 31 , 2012 , the company made no
        discretionary matching contributions .

        8 .

        share-based compensation plans and other incentive plans stock options ,
        stock appreciation rights and employee stock purchase plan the company
        grants options to acquire shares of common stock to certain employees
        and to existing option holders of acquired companies in connection with
        the merging of option plans following an acquisition .

        each option granted and stock appreciation right has an exercise price
        of no less than 100% ( 100 % ) of the fair market value of the common
        stock on the date of the grant .

        the awards have a contractual life of five to ten years and vest over
        two to four years .

        stock options and stock appreciation rights assumed or replaced with
        comparable stock options or stock appreciation rights in conjunction
        with a change in control of the company only become exercisable if the
        holder is also involuntarily terminated ( for a reason other than cause
        ) or quits for good reason within 24 months of a change in control .

        the employee stock purchase plan allows eligible participants to
        purchase shares of the company 2019s common stock through payroll
        deductions of up to 20% ( 20 % ) of eligible compensation on an
        after-tax basis .

        plan participants cannot purchase more than $ 25000 of stock in any
        calendar year .

        the price an employee pays per share is 85% ( 85 % ) of the lower of the
        fair market value of the company 2019s stock on the close of the first
        trading day or last trading day of the purchase period .

        the plan has two purchase periods , the first one from october 1 through
        march 31 and the second one from april 1 through september 30 .

        for the years ended december 31 , 2012 , 2011 and 2010 , employees
        purchased 1.4 million , 2.2 million and 2.7 million shares ,
        respectively , at purchase prices of $ 34.52 and $ 42.96 , $ 30.56 and $
        35.61 , and $ 41.79 and $ 42.00 , respectively .

        the company calculates the value of each employee stock option ,
        estimated on the date of grant , using the black-scholes option pricing
        model .

        the weighted-average estimated fair value of employee stock options
        granted during 2012 , 2011 and 2010 was $ 9.60 , $ 13.25 and $ 21.43 ,
        respectively , using the following weighted-average assumptions: .

                                | 2012             | 2011             | 2010            
        ----------------------- | ---------------- | ---------------- |
        ----------------

        expected volatility     | 24.0% ( 24.0 % ) | 28.8% ( 28.8 % ) | 41.7% (
        41.7 % )

        risk-free interest rate | 0.8% ( 0.8 % )   | 2.1% ( 2.1 % )   | 2.1% (
        2.1 % )  

        dividend yield          | 2.2% ( 2.2 % )   | 0.0% ( 0.0 % )   | 0.0% (
        0.0 % )  

        expected life ( years ) | 6.1              | 6.0              |
        6.1             


        the company uses the implied volatility for traded options on the
        company 2019s stock as the expected volatility assumption required in
        the black-scholes model .

        the selection of the implied volatility approach was based upon the
        availability of actively traded options on the company 2019s stock and
        the company 2019s assessment that implied volatility is more
        representative of future stock price trends than historical volatility .

        the risk-free interest rate assumption is based upon the average daily
        closing rates during the year for u.s .

        treasury notes that have a life which approximates the expected life of
        the option .

        the dividend yield assumption is based on the company 2019s future
        expectation of dividend payouts .

        the expected life of employee stock options represents the average of
        the contractual term of the options and the weighted-average vesting
        period for all option tranches .

        the company has applied forfeiture rates , estimated based on historical
        data , of 13%-50% ( 13%-50 % ) to the option fair values calculated by
        the black-scholes option pricing model .

        these estimated forfeiture rates are applied to grants based on their
        remaining vesting term and may be revised in subsequent periods if
        actual forfeitures differ from these estimates. 
      - "Title: \nText: Copyright?2019 Standard & Poor's, a division of S&P Global.\nAll rights reserved\nMetLife, Inc.  Notes to the Consolidated Financial Statements \x80\x94 (Continued) Commitments Leases In accordance with industry practice, certain of the Company\x80\x99s income from lease agreements with retail tenants are contingent upon the level of the tenants\x80\x99 revenues.\nAdditionally, the Company, as lessee, has entered into various lease and sublease agreements for office space, information technology and other equipment.\nFuture minimum rental and sublease income, and minimum gross rental payments relating to these lease agreements are as follows:"
  - source_sentence: >-
      Instruct: Given a web search query, retrieve relevant passages that answer
      the query.

      Query: Title: 

      Text: what was the average for "other" loans held in 2012 and 2011?
    sentences:
      - >-
        Title: 

        Text: Investments and Derivative Instruments (continued) Security
        Unrealized Loss Aging The following tables present the Company’s
        unrealized loss aging for AFS securities by type and length of time the
        security was in a continuous unrealized loss position.

        |  | December 31, 2011 |

        |  | Less Than 12 Months | 12 Months or More | Total |

        |  | Amortized | Fair | Unrealized | Amortized | Fair | Unrealized |
        Amortized | Fair | Unrealized |

        |  | Cost | Value | Losses | Cost | Value | Losses | Cost | Value |
        Losses |

        | ABS | $629 | $594 | $-35 | $1,169 | $872 | $-297 | $1,798 | $1,466 |
        $-332 |

        | CDOs | 81 | 59 | -22 | 2,709 | 2,383 | -326 | 2,790 | 2,442 | -348 |

        | CMBS | 1,297 | 1,194 | -103 | 2,144 | 1,735 | -409 | 3,441 | 2,929 |
        -512 |

        | Corporate [1] | 4,388 | 4,219 | -169 | 3,268 | 2,627 | -570 | 7,656 |
        6,846 | -739 |

        | Foreign govt./govt. agencies | 218 | 212 | -6 | 51 | 47 | -4 | 269 |
        259 | -10 |

        | Municipal | 299 | 294 | -5 | 627 | 560 | -67 | 926 | 854 | -72 |

        | RMBS | 415 | 330 | -85 | 1,206 | 835 | -371 | 1,621 | 1,165 | -456 |

        | U.S. Treasuries | 343 | 341 | -2 |  |  |  | 343 | 341 | -2 |

        | Total fixed maturities | 7,670 | 7,243 | -427 | 11,174 | 9,059 |
        -2,044 | 18,844 | 16,302 | -2,471 |

        | Equity securities | 167 | 138 | -29 | 439 | 265 | -174 | 606 | 403 |
        -203 |

        | Total securities in an unrealized loss | $7,837 | $7,381 | $-456 |
        $11,613 | $9,324 | $-2,218 | $19,450 | $16,705 | $-2,674 |

        December 31, 2010

        |  | December 31, 2010 |

        |  | Less Than 12 Months | 12 Months or More | Total |

        |  | Amortized | Fair | Unrealized | Amortized | Fair | Unrealized |
        Amortized | Fair | Unrealized |

        |  | Cost | Value | Losses | Cost | Value | Losses | Cost | Value |
        Losses |

        | ABS | $302 | $290 | $-12 | $1,410 | $1,026 | $-384 | $1,712 | $1,316 |
        $-396 |

        | CDOs | 321 | 293 | -28 | 2,724 | 2,274 | -450 | 3,045 | 2,567 | -478 |

        | CMBS | 556 | 530 | -26 | 3,962 | 3,373 | -589 | 4,518 | 3,903 | -615 |

        | Corporate | 5,533 | 5,329 | -199 | 4,017 | 3,435 | -548 | 9,550 |
        8,764 | -747 |

        | Foreign govt./govt. agencies | 356 | 349 | -7 | 78 | 68 | -10 | 434 |
        417 | -17 |

        | Municipal | 7,485 | 7,173 | -312 | 1,046 | 863 | -183 | 8,531 | 8,036
        | -495 |

        | RMBS | 1,744 | 1,702 | -42 | 1,567 | 1,147 | -420 | 3,311 | 2,849 |
        -462 |

        | U.S. Treasuries | 2,436 | 2,321 | -115 | 158 | 119 | -39 | 2,594 |
        2,440 | -154 |

        | Total fixed maturities | 18,733 | 17,987 | -741 | 14,962 | 12,305 |
        -2,623 | 33,695 | 30,292 | -3,364 |

        | Equity securities | 53 | 52 | -1 | 637 | 506 | -131 | 690 | 558 | -132
        |

        | Total securities in an unrealized loss | $18,786 | $18,039 | $-742 |
        $15,599 | $12,811 | $-2,754 | $34,385 | $30,850 | $-3,496 |

        [1] Unrealized losses exclude the change in fair value of bifurcated
        embedded derivative features of certain securities.

        Subsequent changes in fair value are recorded in net realized capital
        gains (losses).

        As of December 31, 2011, AFS securities in an unrealized loss position,
        comprised of 2,549 securities, primarily related to corporate securities
        within the financial services sector, CMBS, and RMBS which have
        experienced significant price deterioration.

        As of December 31, 2011, 75% of these securities were depressed less
        than 20% of cost or amortized cost.

        The decline in unrealized losses during 2011 was primarily attributable
        to a decline in interest rates, partially offset by credit spread
        widening.

        Most of the securities depressed for twelve months or more relate to
        structured securities with exposure to commercial and residential real
        estate, as well as certain floating rate corporate securities or those
        securities with greater than 10 years to maturity, concentrated in the
        financial services sector.

        Current market spreads continue to be significantly wider for structured
        securities with exposure to commercial and residential real estate, as
        compared to spreads at the security’s respective purchase date, largely
        due to the economic and market uncertainties regarding future
        performance of commercial and residential real estate.

        In addition, the majority of securities have a floating-rate coupon
        referenced to a market index where rates have declined substantially.

        The Company neither has an intention to sell nor does it expect to be
        required to sell the securities outlined above.
      - >-
        Title: 

        Text: LOANS HELD FOR SALE Table 15: Loans Held For Sale

        | In millions | December 312012 | December 312011 |

        | Commercial mortgages at fair value | $772 | $843 |

        | Commercial mortgages at lower of cost or market | 620 | 451 |

        | Total commercial mortgages | 1,392 | 1,294 |

        | Residential mortgages at fair value | 2,096 | 1,415 |

        | Residential mortgages at lower of cost or market | 124 | 107 |

        | Total residential mortgages | 2,220 | 1,522 |

        | Other | 81 | 120 |

        | Total | $3,693 | $2,936 |

        We stopped originating commercial mortgage loans held for sale
        designated at fair value in 2008 and continue pursuing opportunities to
        reduce these positions at appropriate prices.

        At December 31, 2012, the balance relating to these loans was $772
        million, compared to $843 million at December 31, 2011.

        We sold $32 million in unpaid principal balances of these commercial
        mortgage loans held for sale carried at fair value in 2012 and sold $25
        million in 2011.
      - >-
        Title: 

        Text: at december 31 , 2012 , total future minimum commitments under
        existing non-cancelable operat- ing leases and purchase obligations were
        as follows: .


        in millions                | 2013   | 2014  | 2015  | 2016  | 2017  |
        thereafter

        -------------------------- | ------ | ----- | ----- | ----- | ----- |
        ----------

        lease obligations          | $ 198  | $ 136 | $ 106 | $ 70  | $ 50  | $
        141     

        purchase obligations ( a ) | 3213   | 828   | 722   | 620   | 808   |
        2654      

        total                      | $ 3411 | $ 964 | $ 828 | $ 690 | $ 858 | $
        2795    


        ( a ) includes $ 3.6 billion relating to fiber supply agreements entered
        into at the time of the company 2019s 2006 transformation plan
        forestland sales and in conjunction with the 2008 acquis- ition of
        weyerhaeuser company 2019s containerboard , packaging and recycling
        business .

        rent expense was $ 231 million , $ 205 million and $ 210 million for
        2012 , 2011 and 2010 , respectively .

        guarantees in connection with sales of businesses , property , equipment
        , forestlands and other assets , interna- tional paper commonly makes
        representations and warranties relating to such businesses or assets ,
        and may agree to indemnify buyers with respect to tax and environmental
        liabilities , breaches of representations and warranties , and other
        matters .

        where liabilities for such matters are determined to be probable and
        subject to reasonable estimation , accrued liabilities are recorded at
        the time of sale as a cost of the transaction .

        environmental proceedings international paper has been named as a
        potentially responsible party in environmental remediation actions under
        various federal and state laws , includ- ing the comprehensive
        environmental response , compensation and liability act ( cercla ) .

        many of these proceedings involve the cleanup of hazardous substances at
        large commercial landfills that received waste from many different
        sources .

        while joint and several liability is authorized under cercla and
        equivalent state laws , as a practical matter , liability for cercla
        cleanups is typically allocated among the many potential responsible
        parties .

        remedial costs are recorded in the consolidated financial statements
        when they become probable and reasonably estimable .

        international paper has estimated the probable liability associated with
        these matters to be approximately $ 92 million in the aggregate at
        december 31 , 2012 .

        one of the matters referenced above is a closed wood treating facility
        located in cass lake , minneso- ta .

        during 2009 , in connection with an environmental site remediation
        action under cercla , international paper submitted to the epa a site
        remediation feasi- bility study .

        in june 2011 , the epa selected and published a proposed soil remedy at
        the site with an estimated cost of $ 46 million .

        the overall remediation reserve for the site is currently $ 48 mil- lion
        to address this selection of an alternative for the soil remediation
        component of the overall site remedy .

        in october 2011 , the epa released a public statement indicating that
        the final soil remedy deci- sion would be delayed .

        in the unlikely event that the epa changes its proposed soil remedy and
        approves instead a more expensive clean-up alternative , the remediation
        costs could be material , and sig- nificantly higher than amounts
        currently recorded .

        in october 2012 , the natural resource trustees for this site provided
        notice to international paper and other potentially responsible parties
        of their intent to per- form a natural resource damage assessment .

        it is premature to predict the outcome of the assessment or to estimate
        a loss or range of loss , if any , which may be incurred .

        in addition to the above matters , other remediation costs typically
        associated with the cleanup of hazardous substances at the company 2019s
        current , closed or formerly-owned facilities , and recorded as
        liabilities in the balance sheet , totaled approximately $ 46 million at
        december 31 , 2012 .

        other than as described above , completion of required remedial actions
        is not expected to have a material effect on our consolidated financial
        statements .

        the company is a potentially responsible party with respect to the
        allied paper , inc./portage creek/ kalamazoo river superfund site (
        kalamazoo river superfund site ) in michigan .

        the epa asserts that the site is contaminated primarily by pcbs as a
        result of discharges from various paper mills located along the river ,
        including a paper mill formerly owned by st .

        regis .

        the company is a successor in interest to st .

        regis .

        international paper has not received any orders from the epa with
        respect to the site and is in the process of collecting information from
        the epa and other parties relative to the kalamazoo river superfund site
        to evaluate the extent of its liability , if any , with respect to the
        site .

        accordingly , it is pre- mature to estimate a loss or range of loss with
        respect to this site .

        also in connection with the kalamazoo river superfund site , the company
        was named as a defendant by georgia-pacific consumer products lp , fort
        james corporation and georgia pacific llc in a contribution and cost
        recovery action for alleged pollution at the kalamazoo river super- fund
        site .

        the suit seeks contribution under cercla for $ 79 million in costs
        purportedly expended by plaintiffs as of the filing of the com- plaint ,
        and for future remediation costs .

        the suit alleges that a mill , during the time it was allegedly owned
        and operated by st .

        regis , discharged pcb contaminated solids and paper residuals resulting
        from paper de-inking and recycling .

        also named as defendants in the suit are ncr corporation and
        weyerhaeuser company .

        in mid-2011 , the suit was 
pipeline_tag: sentence-similarity
library_name: sentence-transformers
metrics:
  - cosine_accuracy@1
  - cosine_accuracy@3
  - cosine_accuracy@5
  - cosine_accuracy@10
  - cosine_precision@1
  - cosine_precision@3
  - cosine_precision@5
  - cosine_precision@10
  - cosine_recall@1
  - cosine_recall@3
  - cosine_recall@5
  - cosine_recall@10
  - cosine_ndcg@10
  - cosine_mrr@10
  - cosine_map@100
  - dot_accuracy@1
  - dot_accuracy@3
  - dot_accuracy@5
  - dot_accuracy@10
  - dot_precision@1
  - dot_precision@3
  - dot_precision@5
  - dot_precision@10
  - dot_recall@1
  - dot_recall@3
  - dot_recall@5
  - dot_recall@10
  - dot_ndcg@10
  - dot_mrr@10
  - dot_map@100
model-index:
  - name: SentenceTransformer based on dunzhang/stella_en_400M_v5
    results:
      - task:
          type: information-retrieval
          name: Information Retrieval
        dataset:
          name: Evaluate
          type: Evaluate
        metrics:
          - type: cosine_accuracy@1
            value: 0.3616504854368932
            name: Cosine Accuracy@1
          - type: cosine_accuracy@3
            value: 0.5194174757281553
            name: Cosine Accuracy@3
          - type: cosine_accuracy@5
            value: 0.6092233009708737
            name: Cosine Accuracy@5
          - type: cosine_accuracy@10
            value: 0.7014563106796117
            name: Cosine Accuracy@10
          - type: cosine_precision@1
            value: 0.3616504854368932
            name: Cosine Precision@1
          - type: cosine_precision@3
            value: 0.17880258899676374
            name: Cosine Precision@3
          - type: cosine_precision@5
            value: 0.12669902912621356
            name: Cosine Precision@5
          - type: cosine_precision@10
            value: 0.07524271844660194
            name: Cosine Precision@10
          - type: cosine_recall@1
            value: 0.33098705501618125
            name: Cosine Recall@1
          - type: cosine_recall@3
            value: 0.4768203883495145
            name: Cosine Recall@3
          - type: cosine_recall@5
            value: 0.5613673139158576
            name: Cosine Recall@5
          - type: cosine_recall@10
            value: 0.6548139158576051
            name: Cosine Recall@10
          - type: cosine_ndcg@10
            value: 0.49595926983262306
            name: Cosine Ndcg@10
          - type: cosine_mrr@10
            value: 0.4667870627215285
            name: Cosine Mrr@10
          - type: cosine_map@100
            value: 0.44823876084168546
            name: Cosine Map@100
          - type: dot_accuracy@1
            value: 0.3325242718446602
            name: Dot Accuracy@1
          - type: dot_accuracy@3
            value: 0.5242718446601942
            name: Dot Accuracy@3
          - type: dot_accuracy@5
            value: 0.5922330097087378
            name: Dot Accuracy@5
          - type: dot_accuracy@10
            value: 0.6747572815533981
            name: Dot Accuracy@10
          - type: dot_precision@1
            value: 0.3325242718446602
            name: Dot Precision@1
          - type: dot_precision@3
            value: 0.1796116504854369
            name: Dot Precision@3
          - type: dot_precision@5
            value: 0.12475728155339803
            name: Dot Precision@5
          - type: dot_precision@10
            value: 0.07257281553398058
            name: Dot Precision@10
          - type: dot_recall@1
            value: 0.30590614886731393
            name: Dot Recall@1
          - type: dot_recall@3
            value: 0.4762135922330097
            name: Dot Recall@3
          - type: dot_recall@5
            value: 0.54457928802589
            name: Dot Recall@5
          - type: dot_recall@10
            value: 0.6272653721682848
            name: Dot Recall@10
          - type: dot_ndcg@10
            value: 0.47234567950079603
            name: Dot Ndcg@10
          - type: dot_mrr@10
            value: 0.4421887039605485
            name: Dot Mrr@10
          - type: dot_map@100
            value: 0.4264453452263192
            name: Dot Map@100

SentenceTransformer based on dunzhang/stella_en_400M_v5

This is a sentence-transformers model finetuned from dunzhang/stella_en_400M_v5. It maps sentences & paragraphs to a 1024-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

  • Model Type: Sentence Transformer
  • Base model: dunzhang/stella_en_400M_v5
  • Maximum Sequence Length: 512 tokens
  • Output Dimensionality: 1024 tokens
  • Similarity Function: Cosine Similarity

Model Sources

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: NewModel 
  (1): Pooling({'word_embedding_dimension': 1024, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Dense({'in_features': 1024, 'out_features': 1024, 'bias': True, 'activation_function': 'torch.nn.modules.linear.Identity'})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
    'Instruct: Given a web search query, retrieve relevant passages that answer the query.\nQuery: Title: \nText: what was the average for "other" loans held in 2012 and 2011?',
    'Title: \nText: LOANS HELD FOR SALE Table 15: Loans Held For Sale\n| In millions | December 312012 | December 312011 |\n| Commercial mortgages at fair value | $772 | $843 |\n| Commercial mortgages at lower of cost or market | 620 | 451 |\n| Total commercial mortgages | 1,392 | 1,294 |\n| Residential mortgages at fair value | 2,096 | 1,415 |\n| Residential mortgages at lower of cost or market | 124 | 107 |\n| Total residential mortgages | 2,220 | 1,522 |\n| Other | 81 | 120 |\n| Total | $3,693 | $2,936 |\nWe stopped originating commercial mortgage loans held for sale designated at fair value in 2008 and continue pursuing opportunities to reduce these positions at appropriate prices.\nAt December 31, 2012, the balance relating to these loans was $772 million, compared to $843 million at December 31, 2011.\nWe sold $32 million in unpaid principal balances of these commercial mortgage loans held for sale carried at fair value in 2012 and sold $25 million in 2011.',
    'Title: \nText: Investments and Derivative Instruments (continued) Security Unrealized Loss Aging The following tables present the Company’s unrealized loss aging for AFS securities by type and length of time the security was in a continuous unrealized loss position.\n|  | December 31, 2011 |\n|  | Less Than 12 Months | 12 Months or More | Total |\n|  | Amortized | Fair | Unrealized | Amortized | Fair | Unrealized | Amortized | Fair | Unrealized |\n|  | Cost | Value | Losses | Cost | Value | Losses | Cost | Value | Losses |\n| ABS | $629 | $594 | $-35 | $1,169 | $872 | $-297 | $1,798 | $1,466 | $-332 |\n| CDOs | 81 | 59 | -22 | 2,709 | 2,383 | -326 | 2,790 | 2,442 | -348 |\n| CMBS | 1,297 | 1,194 | -103 | 2,144 | 1,735 | -409 | 3,441 | 2,929 | -512 |\n| Corporate [1] | 4,388 | 4,219 | -169 | 3,268 | 2,627 | -570 | 7,656 | 6,846 | -739 |\n| Foreign govt./govt. agencies | 218 | 212 | -6 | 51 | 47 | -4 | 269 | 259 | -10 |\n| Municipal | 299 | 294 | -5 | 627 | 560 | -67 | 926 | 854 | -72 |\n| RMBS | 415 | 330 | -85 | 1,206 | 835 | -371 | 1,621 | 1,165 | -456 |\n| U.S. Treasuries | 343 | 341 | -2 | — | — | — | 343 | 341 | -2 |\n| Total fixed maturities | 7,670 | 7,243 | -427 | 11,174 | 9,059 | -2,044 | 18,844 | 16,302 | -2,471 |\n| Equity securities | 167 | 138 | -29 | 439 | 265 | -174 | 606 | 403 | -203 |\n| Total securities in an unrealized loss | $7,837 | $7,381 | $-456 | $11,613 | $9,324 | $-2,218 | $19,450 | $16,705 | $-2,674 |\nDecember 31, 2010\n|  | December 31, 2010 |\n|  | Less Than 12 Months | 12 Months or More | Total |\n|  | Amortized | Fair | Unrealized | Amortized | Fair | Unrealized | Amortized | Fair | Unrealized |\n|  | Cost | Value | Losses | Cost | Value | Losses | Cost | Value | Losses |\n| ABS | $302 | $290 | $-12 | $1,410 | $1,026 | $-384 | $1,712 | $1,316 | $-396 |\n| CDOs | 321 | 293 | -28 | 2,724 | 2,274 | -450 | 3,045 | 2,567 | -478 |\n| CMBS | 556 | 530 | -26 | 3,962 | 3,373 | -589 | 4,518 | 3,903 | -615 |\n| Corporate | 5,533 | 5,329 | -199 | 4,017 | 3,435 | -548 | 9,550 | 8,764 | -747 |\n| Foreign govt./govt. agencies | 356 | 349 | -7 | 78 | 68 | -10 | 434 | 417 | -17 |\n| Municipal | 7,485 | 7,173 | -312 | 1,046 | 863 | -183 | 8,531 | 8,036 | -495 |\n| RMBS | 1,744 | 1,702 | -42 | 1,567 | 1,147 | -420 | 3,311 | 2,849 | -462 |\n| U.S. Treasuries | 2,436 | 2,321 | -115 | 158 | 119 | -39 | 2,594 | 2,440 | -154 |\n| Total fixed maturities | 18,733 | 17,987 | -741 | 14,962 | 12,305 | -2,623 | 33,695 | 30,292 | -3,364 |\n| Equity securities | 53 | 52 | -1 | 637 | 506 | -131 | 690 | 558 | -132 |\n| Total securities in an unrealized loss | $18,786 | $18,039 | $-742 | $15,599 | $12,811 | $-2,754 | $34,385 | $30,850 | $-3,496 |\n[1] Unrealized losses exclude the change in fair value of bifurcated embedded derivative features of certain securities.\nSubsequent changes in fair value are recorded in net realized capital gains (losses).\nAs of December 31, 2011, AFS securities in an unrealized loss position, comprised of 2,549 securities, primarily related to corporate securities within the financial services sector, CMBS, and RMBS which have experienced significant price deterioration.\nAs of December 31, 2011, 75% of these securities were depressed less than 20% of cost or amortized cost.\nThe decline in unrealized losses during 2011 was primarily attributable to a decline in interest rates, partially offset by credit spread widening.\nMost of the securities depressed for twelve months or more relate to structured securities with exposure to commercial and residential real estate, as well as certain floating rate corporate securities or those securities with greater than 10 years to maturity, concentrated in the financial services sector.\nCurrent market spreads continue to be significantly wider for structured securities with exposure to commercial and residential real estate, as compared to spreads at the security’s respective purchase date, largely due to the economic and market uncertainties regarding future performance of commercial and residential real estate.\nIn addition, the majority of securities have a floating-rate coupon referenced to a market index where rates have declined substantially.\nThe Company neither has an intention to sell nor does it expect to be required to sell the securities outlined above.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 1024]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Evaluation

Metrics

Information Retrieval

Metric Value
cosine_accuracy@1 0.3617
cosine_accuracy@3 0.5194
cosine_accuracy@5 0.6092
cosine_accuracy@10 0.7015
cosine_precision@1 0.3617
cosine_precision@3 0.1788
cosine_precision@5 0.1267
cosine_precision@10 0.0752
cosine_recall@1 0.331
cosine_recall@3 0.4768
cosine_recall@5 0.5614
cosine_recall@10 0.6548
cosine_ndcg@10 0.496
cosine_mrr@10 0.4668
cosine_map@100 0.4482
dot_accuracy@1 0.3325
dot_accuracy@3 0.5243
dot_accuracy@5 0.5922
dot_accuracy@10 0.6748
dot_precision@1 0.3325
dot_precision@3 0.1796
dot_precision@5 0.1248
dot_precision@10 0.0726
dot_recall@1 0.3059
dot_recall@3 0.4762
dot_recall@5 0.5446
dot_recall@10 0.6273
dot_ndcg@10 0.4723
dot_mrr@10 0.4422
dot_map@100 0.4264

Training Details

Training Dataset

Unnamed Dataset

  • Size: 2,256 training samples
  • Columns: sentence_0 and sentence_1
  • Approximate statistics based on the first 1000 samples:
    sentence_0 sentence_1
    type string string
    details
    • min: 29 tokens
    • mean: 45.01 tokens
    • max: 121 tokens
    • min: 26 tokens
    • mean: 406.1 tokens
    • max: 512 tokens
  • Samples:
    sentence_0 sentence_1
    Instruct: Given a web search query, retrieve relevant passages that answer the query.
    Query: Title:
    Text: In the year with largest amount of Net credit losses, what's the amount of Revenues, net of interest expense and Total operating expenses? (in million)
    Title:
    Text: Comparison of Five-Year Cumulative Total Return The following graph compares the cumulative total return on Citigroup’s common stock with the S&P 500 Index and the S&P Financial Index over the five-year period extending through December31, 2009.
    The graph assumes that $100 was invested on December31, 2004 in Citigroup’s common stock, the S&P 500 Index and the S&P Financial Index and that all dividends were reinvested.
    Instruct: Given a web search query, retrieve relevant passages that answer the query.
    Query: Title:
    Text: what was the total of net earnings attributable to pmi in 2017?
    Title:
    Text: the fair value of the psu award at the date of grant is amortized to expense over the performance period , which is typically three years after the date of the award , or upon death , disability or reaching the age of 58 .
    as of december 31 , 2017 , pmi had $ 34 million of total unrecognized compensation cost related to non-vested psu awards .
    this cost is recognized over a weighted-average performance cycle period of two years , or upon death , disability or reaching the age of 58 .
    during the years ended december 31 , 2017 , and 2016 , there were no psu awards that vested .
    pmi did not grant any psu awards during note 10 .
    earnings per share : unvested share-based payment awards that contain non-forfeitable rights to dividends or dividend equivalents are participating securities and therefore are included in pmi 2019s earnings per share calculation pursuant to the two-class method .
    basic and diluted earnings per share ( 201ceps 201d ) were calculated using the following: .

    ( in millions )
    Instruct: Given a web search query, retrieve relevant passages that answer the query.
    Query: Title:
    Text: for the terrestar acquisition what will the final cash purchase price be in millions paid upon closing?
    Title:
    Text: dish network corporation notes to consolidated financial statements - continued this transaction was accounted for as a business combination using purchase price accounting .
    the allocation of the purchase consideration is in the table below .
    purchase allocation ( in thousands ) .

  • Loss: MultipleNegativesRankingLoss with these parameters:
    {
        "scale": 20.0,
        "similarity_fct": "cos_sim"
    }
    

Training Hyperparameters

Non-Default Hyperparameters

  • eval_strategy: steps
  • per_device_train_batch_size: 16
  • per_device_eval_batch_size: 16
  • num_train_epochs: 2
  • fp16: True
  • batch_sampler: no_duplicates
  • multi_dataset_batch_sampler: round_robin

All Hyperparameters

Click to expand
  • overwrite_output_dir: False
  • do_predict: False
  • eval_strategy: steps
  • prediction_loss_only: True
  • per_device_train_batch_size: 16
  • per_device_eval_batch_size: 16
  • per_gpu_train_batch_size: None
  • per_gpu_eval_batch_size: None
  • gradient_accumulation_steps: 1
  • eval_accumulation_steps: None
  • torch_empty_cache_steps: None
  • learning_rate: 5e-05
  • weight_decay: 0.0
  • adam_beta1: 0.9
  • adam_beta2: 0.999
  • adam_epsilon: 1e-08
  • max_grad_norm: 1
  • num_train_epochs: 2
  • max_steps: -1
  • lr_scheduler_type: linear
  • lr_scheduler_kwargs: {}
  • warmup_ratio: 0.0
  • warmup_steps: 0
  • log_level: passive
  • log_level_replica: warning
  • log_on_each_node: True
  • logging_nan_inf_filter: True
  • save_safetensors: True
  • save_on_each_node: False
  • save_only_model: False
  • restore_callback_states_from_checkpoint: False
  • no_cuda: False
  • use_cpu: False
  • use_mps_device: False
  • seed: 42
  • data_seed: None
  • jit_mode_eval: False
  • use_ipex: False
  • bf16: False
  • fp16: True
  • fp16_opt_level: O1
  • half_precision_backend: auto
  • bf16_full_eval: False
  • fp16_full_eval: False
  • tf32: None
  • local_rank: 0
  • ddp_backend: None
  • tpu_num_cores: None
  • tpu_metrics_debug: False
  • debug: []
  • dataloader_drop_last: False
  • dataloader_num_workers: 0
  • dataloader_prefetch_factor: None
  • past_index: -1
  • disable_tqdm: False
  • remove_unused_columns: True
  • label_names: None
  • load_best_model_at_end: False
  • ignore_data_skip: False
  • fsdp: []
  • fsdp_min_num_params: 0
  • fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
  • fsdp_transformer_layer_cls_to_wrap: None
  • accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
  • deepspeed: None
  • label_smoothing_factor: 0.0
  • optim: adamw_torch
  • optim_args: None
  • adafactor: False
  • group_by_length: False
  • length_column_name: length
  • ddp_find_unused_parameters: None
  • ddp_bucket_cap_mb: None
  • ddp_broadcast_buffers: False
  • dataloader_pin_memory: True
  • dataloader_persistent_workers: False
  • skip_memory_metrics: True
  • use_legacy_prediction_loop: False
  • push_to_hub: False
  • resume_from_checkpoint: None
  • hub_model_id: None
  • hub_strategy: every_save
  • hub_private_repo: False
  • hub_always_push: False
  • gradient_checkpointing: False
  • gradient_checkpointing_kwargs: None
  • include_inputs_for_metrics: False
  • eval_do_concat_batches: True
  • fp16_backend: auto
  • push_to_hub_model_id: None
  • push_to_hub_organization: None
  • mp_parameters:
  • auto_find_batch_size: False
  • full_determinism: False
  • torchdynamo: None
  • ray_scope: last
  • ddp_timeout: 1800
  • torch_compile: False
  • torch_compile_backend: None
  • torch_compile_mode: None
  • dispatch_batches: None
  • split_batches: None
  • include_tokens_per_second: False
  • include_num_input_tokens_seen: False
  • neftune_noise_alpha: None
  • optim_target_modules: None
  • batch_eval_metrics: False
  • eval_on_start: False
  • use_liger_kernel: False
  • eval_use_gather_object: False
  • batch_sampler: no_duplicates
  • multi_dataset_batch_sampler: round_robin

Training Logs

Epoch Step Evaluate_cosine_map@100
0 0 0.2566
1.0 141 0.3931
2.0 282 0.4482

Framework Versions

  • Python: 3.10.12
  • Sentence Transformers: 3.1.1
  • Transformers: 4.45.2
  • PyTorch: 2.5.1+cu121
  • Accelerate: 1.1.1
  • Datasets: 3.1.0
  • Tokenizers: 0.20.3

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

MultipleNegativesRankingLoss

@misc{henderson2017efficient,
    title={Efficient Natural Language Response Suggestion for Smart Reply},
    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
    year={2017},
    eprint={1705.00652},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}