Evaluation of experiments with NER-based re-ranking Sample Clauses

Evaluation of experiments with NER-based re-ranking. We have tested different re-ranking strategies in the two evaluation datasets: the ▇▇▇▇- ▇▇▇▇ news corpus and the #Microposts2014 tweets corpus. Table 1 shows some of the results we obtained. The first row shows the precision and recall attained by DBSpotlight, with no confidence threshold specified. In this baseline case, precision is lowest and recall is highest. DBSpotlight 0.2546 0.7477 0.3799 0.7272 DBSpotlight (c > 0.9) 0.3002 0.6871 0.4178 0.7639 Re-ranked DBSpotlight 0.2546 0.7477 0.3799 0.6979 Re-ranked DBSpotlight (c > 0.9) 0.3140 0.7342 0.4399 0.7369 The other rows combine a confidence threshold of 0.93 with the re-ranking heuristics explained above. The best F-measure (0.4399) in detection is attained with c>0.9 and re-ranking. However the most remarkable result here appears in the third row: re- ranking is actually detrimental to accuracy in classification, while not improving precision and recall in detection. The following example illustrates what is actually happening: Following are highlights of the midday briefing by the European Commission on Wednesday.  Stanford NER correctly annotates European Commission as ORGANISATION.  DBPedia Spotlight provides this ranked list of candidate annotations, with their probabilities. European_Comission (0.9999999995178541) ECHO_(European_Commission) (4.532487558872544E-10) Barroso_Commission (6.689508820986744E-21) Directorate- General_for_Education_and_Culture_(European_Commission) (1.9533030489271525E-22) The good one is, correctly, the first one, but, unfortunately, its dbtype is empty, so the re-ranking strategy incorrectly picks the first one with a dbtype compatible with ORGANISATION (the one in bold).
View Source

Related to Evaluation of experiments with NER-based re-ranking

  • Procedures and Presumptions for Determination of Entitlement to Indemnification It is the intent of this Agreement to secure for Indemnitee rights of indemnity that are as favorable as may be permitted under the DGCL and public policy of the State of Delaware. Accordingly, the parties agree that the following procedures and presumptions shall apply in the event of any question as to whether Indemnitee is entitled to indemnification under this Agreement: (a) To obtain indemnification under this Agreement, Indemnitee shall submit to the Company a written request, including therein or therewith such documentation and information as is reasonably available to Indemnitee and is reasonably necessary to determine whether and to what extent Indemnitee is entitled to indemnification. The Secretary of the Company shall, promptly upon receipt of such a request for indemnification, advise the Board in writing that Indemnitee has requested indemnification. Notwithstanding the foregoing, any failure of Indemnitee to provide such a request to the Company, or to provide such a request in a timely fashion, shall not relieve the Company of any liability that it may have to Indemnitee unless, and to the extent that, such failure actually and materially prejudices the interests of the Company. (b) Upon written request by Indemnitee for indemnification pursuant to the first sentence of Section 6(a) hereof, a determination with respect to Indemnitee’s entitlement thereto shall be made in the specific case by one of the following four methods, which shall be at the election of the Board (1) by a majority vote of the Disinterested Directors (as defined below), even though less than a quorum, (2) by a committee of Disinterested Directors designated by a majority vote of the Disinterested Directors, even though less than a quorum, (3) if there are no Disinterested Directors or if the Disinterested Directors so direct, by Independent Counsel (as defined below) in a written opinion to the Board, a copy of which shall be delivered to the Indemnitee, or (4) if so directed by the Board, by the stockholders of the Company. (c) If the determination of entitlement to indemnification is to be made by Independent Counsel pursuant to Section 6(b) hereof, the Independent Counsel shall be selected as provided in this Section 6(c). The Independent Counsel shall be selected by the Board. Indemnitee may, within ten (10) days after such written notice of selection shall have been given, deliver to the Company a written objection to such selection; provided, however, that such objection may be asserted only on the ground that the Independent Counsel so selected does not meet the requirements of “Independent Counsel” as defined in Section 13 of this Agreement, and the objection shall set forth with particularity the factual basis of such assertion. Absent a proper and timely objection, the person so selected shall act as Independent Counsel. If a written objection is made and substantiated, the Independent Counsel selected may not serve as Independent Counsel unless and until such objection is withdrawn or a court has determined that such objection is without merit. If, within twenty (20) days after submission by Indemnitee of a written request for indemnification pursuant to Section 6(a) hereof, no Independent Counsel shall have been selected and not objected to, either the Company or Indemnitee may petition the Court of Chancery of the State of Delaware or other court of competent jurisdiction for resolution of any objection which shall have been made by the Indemnitee to the Company’s selection of Independent Counsel and/or for the appointment as Independent Counsel of a person selected by the court or by such other person as the court shall designate, and the person with respect to whom all objections are so resolved or the person so appointed shall act as Independent Counsel under Section 6(b) hereof. The Company shall pay any and all reasonable fees and expenses of Independent Counsel incurred by such Independent Counsel in connection with acting pursuant to Section 6(b) hereof, and the Company shall pay all reasonable fees and expenses incident to the procedures of this Section 6(c), regardless of the manner in which such Independent Counsel was selected or appointed. (d) In making a determination with respect to entitlement to indemnification hereunder, the person or persons or entity making such determination shall presume that Indemnitee is entitled to indemnification under this Agreement. Anyone seeking to overcome this presumption shall have the burden of proof and the burden of persuasion by clear and convincing evidence. Neither the failure of the Company (including by its directors or Independent Counsel) to have made a determination prior to the commencement of any action pursuant to this Agreement that indemnification is proper in the circumstances because Indemnitee has met the applicable standard of conduct, nor an actual determination by the Company (including by its directors or Independent Counsel) that Indemnitee has not met such applicable standard of conduct, shall be a defense to the action or create a presumption that Indemnitee has not met the applicable standard of conduct. (e) Indemnitee shall be deemed to have acted in good faith if Indemnitee’s action is based on the records or books of account of the Enterprise (as hereinafter defined), including financial statements, or on information supplied to Indemnitee by the officers of the Enterprise in the course of their duties, or on the advice of legal counsel for the Enterprise or on information or records given or reports made to the Enterprise by an independent certified public accountant or by an appraiser or other expert selected with reasonable care by the Enterprise. In addition, the knowledge and/or actions, or failure to act, of any director, officer, agent or employee of the Enterprise shall not be imputed to Indemnitee for purposes of determining the right to indemnification under this Agreement. Whether or not the foregoing provisions of this Section 6(e) are satisfied, it shall in any event be presumed that Indemnitee has at all times acted in good faith and in a manner Indemnitee reasonably believed to be in or not opposed to the best interests of the Company. Anyone seeking to overcome this presumption shall have the burden of proof and the burden of persuasion by clear and convincing evidence. (f) If the person, persons or entity empowered or selected under Section 6 to determine whether Indemnitee is entitled to indemnification shall not have made a determination within sixty (60) days after receipt by the Company of the request therefor, the requisite determination of entitlement to indemnification shall be deemed to have been made and Indemnitee shall be entitled to such indemnification absent (i) a misstatement by Indemnitee of a material fact, or an omission of a material fact necessary to make Indemnitee’s statement not materially misleading, in connection with the request for indemnification, or (ii) a prohibition of such indemnification under applicable law; provided, however, that such sixty (60) day period may be extended for a reasonable time, not to exceed an additional thirty (30) days, if the person, persons or entity making such determination with respect to entitlement to indemnification in good faith requires such additional time to obtain or evaluate documentation and/or information relating thereto; and provided further, that the foregoing provisions of this Section 6(f) shall not apply if the determination of entitlement to indemnification is to be made by the stockholders pursuant to Section 6(b) of this Agreement and if (A) within fifteen (15) days after receipt by the Company of the request for such determination, the Board or the Disinterested Directors, if appropriate, resolve to submit such determination to the stockholders for their consideration at an annual meeting thereof to be held within seventy-five (75) days after such receipt and such determination is made thereat, or (B) a special meeting of stockholders is called within fifteen (15) days after such receipt for the purpose of making such determination, such meeting is held for such purpose within sixty (60) days after having been so called and such determination is made thereat. (g) Indemnitee shall cooperate with the person, persons or entity making such determination with respect to Indemnitee’s entitlement to indemnification, including providing to such person, persons or entity upon reasonable advance request any documentation or information which is not privileged or otherwise protected from disclosure and which is reasonably available to Indemnitee and reasonably necessary to such determination. Any Independent Counsel, member of the Board or stockholder of the Company shall act reasonably and in good faith in making a determination regarding the Indemnitee’s entitlement to indemnification under this Agreement. Any costs or expenses (including attorneys’ fees and disbursements) incurred by Indemnitee in so cooperating with the person, persons or entity making such determination shall be borne by the Company (irrespective of the determination as to Indemnitee’s entitlement to indemnification) and the Company hereby indemnifies and agrees to hold Indemnitee harmless therefrom. (h) The Company acknowledges that a settlement or other disposition short of final judgment may be successful if it permits a party to avoid expense, delay, distraction, disruption and uncertainty. In the event that any action, claim or proceeding to which Indemnitee is a party is resolved in any manner other than by adverse judgment against Indemnitee (including, without limitation, settlement of such action, claim or proceeding with or without payment of money or other consideration) it shall be presumed that Indemnitee has been successful on the merits or otherwise in such action, suit or proceeding. Anyone seeking to overcome this presumption shall have the burden of proof and the burden of persuasion by clear and convincing evidence. (i) The termination of any Proceeding or of any claim, issue or matter therein, by judgment, order, settlement or conviction, or upon a plea of nolo contendere or its equivalent, shall not (except as otherwise expressly provided in this Agreement) of itself adversely affect the right of Indemnitee to indemnification or create a presumption that Indemnitee did not act in good faith and in a manner which Indemnitee reasonably believed to be in or not opposed to the best interests of the Company or, with respect to any criminal Proceeding, that Indemnitee had reasonable cause to believe that Indemnitee’s conduct was unlawful.

  • Independent Evaluation Buyer is an experienced and knowledgeable investor in the oil and gas business. Buyer has been advised by and has relied solely on its own expertise and legal, tax, title, reservoir engineering, environmental and other professional counsel concerning this transaction, the Properties, the value thereof and title thereto.

  • Evaluation Cycle Goal Setting and Development of the Educator Plan A) Every Educator has an Educator Plan that includes, but is not limited to, one goal related to the improvement of practice; one goal for the improvement of student learning. The Plan also outlines actions the Educator must take to attain the goals established in the Plan and benchmarks to assess progress. Goals may be developed by individual Educators, by the Evaluator, or by teams, departments, or groups of Educators who have the similar roles and/or responsibilities. See Sections 15-19 for more on Educator Plans. B) To determine the goals to be included in the Educator Plan, the Evaluator reviews the goals the Educator has proposed in the Self-Assessment, using evidence of Educator performance and impact on student learning, growth and achievement based on the Educator’s self-assessment and other sources that Evaluator shares with the Educator. The process for determining the Educator’s impact on student learning, growth and achievement will be determined after ESE issues guidance on this matter. See #22, below. C) Educator Plan Development Meetings shall be conducted as follows: i) Educators in the same school may meet with the Evaluator in teams and/or individually at the end of the previous evaluation cycle or by October 15th of the next academic year to develop their Educator Plan. Educators shall not be expected to meet during the summer hiatus. ii) For those Educators new to the school, the meeting with the Evaluator to establish the Educator Plan must occur by October 15th or within six weeks of the start of their assignment in that school iii) The Evaluator shall meet individually with Educators with PTS and ratings of needs improvement or unsatisfactory to develop professional practice goal(s) that must address specific standards and indicators identified for improvement. In addition, the goals may address shared grade level or subject matter goals. D) The Evaluator completes the Educator Plan by November 1st. The Educator shall sign the Educator Plan within 5 school days of its receipt and may include a written response. The Educator’s signature indicates that the Educator received the plan in a timely fashion. The signature does not indicate agreement or disagreement with its contents. The Evaluator retains final authority over the content of the Educator’s Plan.

  • Evaluation of Students A teacher shall maintain the right and responsibility to determine grades and other evaluation of students within the grading policies of the District based upon professional judgment of available criteria pertinent to any given subject area or activity for which the teacher is responsible. No grade or evaluation shall be changed without consultation with the teacher.

  • Procedure for Third Party Claims The obligations and liabilities of each Party with respect to Third-Party Claims shall be subject to the following terms and conditions: (i) Promptly upon receiving a written notice of a Third-Party Claim, the Indemnifying Party may elect, at its sole option, to undertake the defense thereof by outside counsel of its own choosing, which outside counsel shall be reasonably satisfactory to the Indemnified Party, by sending written notice of its election to the Indemnified Party; provided however, that if, in the Indemnified Party’s and the Indemnifying Party’s reasonable judgment, a conflict of interest exists between the Indemnified Party and the Indemnifying Party with respect to such Third-Party Claim, or if the Indemnifying Party elects not to defend or otherwise does not promptly defend such Third-Party Claim, such Indemnified Party shall be entitled to undertake the defense of, and to compromise or settle, such Third-Party Claim on behalf, for the account, and at the risk of the Indemnifying Party, to the extent that the Indemnifying Party is determined to be obligated to indemnify the Indemnified Party under this Agreement with respect to such Third-Party Claim. The written notice of the Third-Party Claim shall contain all material information known to the Indemnified Party with respect to such Third-Party Claim and shall include copies of materials submitted to Indemnified Party by the Third-Party with respect to such Third-Party Claim. (ii) If the Indemnifying Party elects to undertake and diligently pursue the defense of a Third-Party Claim hereunder, the Indemnifying Party shall control all aspects of the defense and settlement of such Third-Party Claim and may settle, compromise or enter into a judgment with respect to such Third-Party Claim; provided that the Indemnifying Party shall not enter into any such settlement, compromise or judgment without the prior written consent of the Indemnified Party if such settlement, compromise or judgment would result in the imposition of any non-monetary liability or obligation on the Indemnified Party. If the Indemnifying Party assumes control of the defense under this Article 9, the Indemnified Party shall fully cooperate with the Indemnifying Party in connection therewith and may employ, at any time, a separate outside counsel to represent it; provided however, that the Indemnified Party shall be solely responsible for the costs and expenses of any such separate outside counsel. If the Indemnified Party undertakes the defense of a Third-Party Claim hereunder, the Indemnified Party shall not settle, compromise, or enter into any judgment with respect to such Third-Party Claim for which it is seeking or shall seek indemnification hereunder without the prior written consent of Indemnifying Party, which written consent shall not be unreasonably withheld, conditioned or delayed. (iii) The Indemnified Party shall provide the Indemnifying Party with access to all reasonably requested records and documents of the Indemnified Party relating to any Third-Party Claim, other than documents for which the Indemnified Party has claimed or shall claim a legal privilege.