<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "journalpublishing3.dtd">
<article article-type="research-article" dtd-version="3.0" xml:lang="en" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">GYA</journal-id>
<journal-title-group>
<journal-title>Grasas y Aceites</journal-title>
</journal-title-group>
<issn pub-type="epub">0017-3495</issn>
<publisher>
<publisher-name>Consejo Superior de Investigaciones Cientificas</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">GYA201733_e203-0107171</article-id>
<article-id pub-id-type="doi">10.3989/gya.0107171</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Articles</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Selecting and training a panel to evaluate the rancid defect in soybean oil and fish hamburgers</article-title>
<trans-title-group xml:lang="es">
<trans-title>Selecci&#x00F3;n y entrenamiento de un panel para evaluar el defecto rancio en aceite de soja y hamburguesas de pescado</trans-title>
</trans-title-group>
<alt-title alt-title-type="running-head">Selecting and training a panel to evaluate the rancid defect in soybean oil and fish hamburgers</alt-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name>
<surname>Marques</surname>
<given-names>C.</given-names>
</name>
</contrib>
<contrib contrib-type="author">
<name>
<surname>dos Reis</surname>
<given-names>A.S.</given-names>
</name>
</contrib>
<contrib contrib-type="author">
<name>
<surname>da Silva</surname>
<given-names>L.D.</given-names>
</name>
</contrib>
<contrib contrib-type="author">
<name>
<surname>Carpes</surname>
<given-names>S.T.</given-names>
</name>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name>
<surname>Mitterer-Dalto&#x00E9;</surname>
<given-names>M.L.</given-names>
</name>
<xref ref-type="corresp" rid="cor1">&#x002A;</xref>
</contrib>
</contrib-group>
<aff>Graduate Program in Chemical and Biochemical Technology Process, Chemistry Department, Federal University of Technology, Km 01, 85503-390 - Paran&#x00E1;, Pato Branco, PR, Brazil</aff>
<author-notes>
<corresp id="cor1">
<label>&#x002A;</label>Corresponding author: <email xlink:href="marinadaltoe@utfpr.edu.br">marinadaltoe@utfpr.edu.br</email>
</corresp>
<fn>
<p><bold>ORCID</bold>: Marques C <ext-link ext-link-type="uri" xlink:href="http://orcid.org/0000-0002-0215-2679">http://orcid.org/0000-0002-0215-2679</ext-link>, dos Reis AS <ext-link ext-link-type="uri" xlink:href="http://orcid.org/0000-0002-5508-8412">http://orcid.org/0000-0002-5508-8412</ext-link>, da Silva LD <ext-link ext-link-type="uri" xlink:href="http://orcid.org/0000-0002-7538-4198">http://orcid.org/0000-0002-7538-4198</ext-link>, Carpes ST <ext-link ext-link-type="uri" xlink:href="http://orcid.org/0000-0001-8625-7795">http://orcid.org/0000-0001-8625-7795</ext-link>, Mitterer-Dalto&#x00E9; ML <ext-link ext-link-type="uri" xlink:href="http://orcid.org/0000-0002-6761-9321">http://orcid.org/0000-0002-6761-9321</ext-link></p>
</fn>
</author-notes>
<pub-date pub-type="epub">
<day>30</day>
<month>09</month>
<year>2017</year>
</pub-date>
<pub-date pub-type="collection">
<year>2017</year>
</pub-date>
<volume>68</volume>
<issue>2</issue>
<elocation-id content-type="doi">10.3989/gya.0107171</elocation-id>
<history>
<date date-type="received">
<day>19</day>
<month>01</month>
<year>2017</year>
</date>
<date date-type="accepted">
<day>27</day>
<month>03</month>
<year>2017</year>
</date>
</history>
<permissions>
<copyright-statement>&#x00A9; 2017 CSIC</copyright-statement>
<copyright-year>2017</copyright-year>
<license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/3.0/es/deed.en">
<license-p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY) Spain 3.0.</license-p>
</license>
</permissions>
<abstract>
<title>SUMMARY</title>
<p>Due to its composition of unsaturated and polyunsaturated fatty acids, oils and fats are very susceptible to oxidation, with rancidity being one of the main defects. Among the several existing methodologies to monitor oxidation in foods, sensory analysis stands out because of the sensitivity of responses. Accordingly, this study aimed to select and train a panel of expert assessors to identify the rancid flavor, showing the statistical steps in the process. Assessors were selected according to their individual performance, statistically analyzed by ANOVA and Tukey&#x2019;s mean comparison, Wald Sequential Analysis and chi-square test. The validation of the trained panel was carried out with the sensory analysis of fish burgers and soybean oil. F Value and box-plot graphic methods were effective for better visualization of results when used along with the mean and standard deviation tables. The final trained panel consisted of seven assessors, who have been able to identify and differentiate rancid taste in both samples used for validation.</p>
</abstract>
<trans-abstract xml:lang="es">
<title>RESUMEN</title>
<p><bold><italic>Selecci&#x00F3;n y entrenamiento de un panel para evaluar el defecto rancio en aceite de soja y hamburguesas de pescado.</italic></bold> Debido a su composici&#x00F3;n en &#x00E1;cidos grasos insaturados y poliinsaturados, los aceites y grasas son muy susceptibles a la oxidaci&#x00F3;n, siendo la rancidez uno de los principales defectos. Entre las diversas metodolog&#x00ED;as existentes para seguir la oxidaci&#x00F3;n en los alimentos, el an&#x00E1;lisis sensorial destaca por la sensibilidad de las respuestas. Este estudio tuvo como objetivo seleccionar y capacitar a un panel de catadores entrenados para identificar el sabor rancio y se muestra estadisticamente los pasos del proceso. Los catadores fueron seleccionados de acuerdo a su capacidad individual y estad&#x00ED;sticamente analizados por ANOVA comparando las medias mediante Tukey, an&#x00E1;lisis secuencial de Wald y prueba de chi-cuadrado. La validaci&#x00F3;n del panel entrenado se realiz&#x00F3; con el an&#x00E1;lisis sensorial de hamburguesas de pescado y aceite de soja. El valor F y la representaci&#x00F3;n gr&#x00E1;fica boxplot fueron eficaces para una mejor visualizaci&#x00F3;n de los resultados cuando se utilizan junto con las tablas de desviaci&#x00F3;n media y est&#x00E1;ndar. El panel final estuvo formado por siete catadores que fueron capaces de identificar y diferenciar el sabor rancio en ambas muestras utilizadas para su validaci&#x00F3;n.</p>
</trans-abstract>
<kwd-group xml:lang="en">
<title>KEYWORDS</title>
<kwd>Bioactive Phytochemicals</kwd>
<kwd>Fish</kwd>
<kwd>Flavors</kwd>
<kwd>Food Quality</kwd>
<kwd>Sensory Analysis</kwd>
</kwd-group>
<kwd-group xml:lang="es">
<title>PALABRAS CLAVE</title>
<kwd>An&#x00E1;lisis sensorial</kwd>
<kwd>Calidad de los alimentos</kwd>
<kwd>Fitoqu&#x00ED;micos Bioactivos</kwd>
<kwd>Pescado</kwd>
<kwd>Sabores</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="sec1" sec-type="intro">
<title>1. INTRODUCTION</title>
<p>The sensory perception of food is placed first on the in-mouth transformation and that is the reason why it is so dynamic (Ares <italic>et al</italic>., <xref ref-type="bibr" rid="cit0001">2015</xref>) depending on the response of each individual. However, consumer preferences, acceptance and feedback are very important to the market (Ares <italic>et al</italic>., <xref ref-type="bibr" rid="cit0001">2015</xref>), which demonstrates the importance of sensory analysis in many areas, from the development of products to quality control (Ares <italic>et al</italic>., <xref ref-type="bibr" rid="cit0001">2015</xref>; Latreille <italic>et al</italic>., <xref ref-type="bibr" rid="cit0019">2006</xref>).</p>
<p>Therefore, selection and training are required to assess reliable measurements from individual reactions (Latreille <italic>et al</italic>., <xref ref-type="bibr" rid="cit0019">2006</xref>; Etaio <italic>et al</italic>., <xref ref-type="bibr" rid="cit0013">2010</xref>). To accredit a trained panel, the assessors must present repeatability (consensus), reproducibility, discrimination ability; and they must be able to notice differences that might seem small to consumers, with all technical competence acquired remaining over time (Etaio <italic>et al</italic>., <xref ref-type="bibr" rid="cit0013">2010</xref>; Gonz&#x00E1;lez <italic>et al</italic>., <xref ref-type="bibr" rid="cit0014">2007</xref>; L&#x00F3;pez-Aguilar <italic>et al</italic>., <xref ref-type="bibr" rid="cit0022">2007</xref>). A number of five to eight trained assessors are sufficient for a reliable evaluation (Dutcosky, <xref ref-type="bibr" rid="cit0011">2007</xref>).</p>
<p>The steps to be followed to achieve a reliable sensory trained panel are basically: assessor selection, basic, and specific training, assessor qualification and method validation (Etaio <italic>et al</italic>., <xref ref-type="bibr" rid="cit0013">2010</xref>). However, this entire process is known to be time consuming, expensive and not practical due to several aspects (Kamruzzaman <italic>et al</italic>., <xref ref-type="bibr" rid="cit0018">2013</xref>). It is common practice by many researchers that require precise measurements to hire an accredited trained panel (Sinesio <italic>et al</italic>., <xref ref-type="bibr" rid="cit0026">1990</xref>; Campo <italic>et al</italic>., <xref ref-type="bibr" rid="cit0007">2006</xref>; Kamruzzaman <italic>et al</italic>., <xref ref-type="bibr" rid="cit0018">2013</xref>; Borr&#x00E0;s <italic>et al.</italic>, 2015) or to simply use instrumental methods for flavor testing (Lee and Choe, <xref ref-type="bibr" rid="cit0021">2012</xref>) instead of training their own assessors.</p>
<p>Several studies, from the oldest (Banfield and Harries, <xref ref-type="bibr" rid="cit0003">1975</xref>; Sinesio <italic>et al</italic>., <xref ref-type="bibr" rid="cit0026">1990</xref>; Lea <italic>et al</italic>., <xref ref-type="bibr" rid="cit0020">1995</xref>) to the newest (Latreille <italic>et al</italic>., <xref ref-type="bibr" rid="cit0019">2006</xref>) approach the statistic performance of trained assessors. However, references for selecting and training demonstrate the details of the process, including the temperature and time of rancidity, and are very limited in the literature (Latreille <italic>et al</italic>., <xref ref-type="bibr" rid="cit0019">2006</xref>; Elortondo <italic>et al</italic>., <xref ref-type="bibr" rid="cit0012">2007</xref>; Etaio <italic>et al</italic>., <xref ref-type="bibr" rid="cit0013">2010</xref>).</p>
<p>To our knowledge, there are no published studies reporting the selection and training of assessors for the rancid defect in oils and fats specifically, including the time and temperature of rancidity with results demonstrated statistically. The closest to it is the sunflower oil shelf-life estimation detailed by Houhg and Fiszman, (<xref ref-type="bibr" rid="cit0015">2005)</xref> where the focus is a demonstration of the cut-off point methodology.</p>
<p>The undesirable compounds known as <italic>off-flavors</italic> in oil and fat are products of oxidation reactions which also destroy essential fatty acids resulting in a loss in nutritional value in addition to the sensory rejection (Lee and Choe, <xref ref-type="bibr" rid="cit0021">2012</xref>). The most common <italic>off-flavor</italic> is rancidity. Two of many contributors to the rancid flavor are the hexanal and nonanal compounds (Campo <italic>et al</italic>., <xref ref-type="bibr" rid="cit0007">2006</xref>; Ibrahim, <xref ref-type="bibr" rid="cit0016">2001</xref>; L&#x00F3;pez-Aguilar <italic>et al</italic>., <xref ref-type="bibr" rid="cit0022">2007</xref>) which lend a distinct odor to this defect. Human perception of oxidized flavors in food with high fat content is more accurate than chemical methods, and aids in the extent of deterioration evaluation when a well-trained panel is available (Sinesio <italic>et al</italic>., <xref ref-type="bibr" rid="cit0026">1990</xref>).</p>
<p>To encourage the consumption of fish, due to the high nutritional value of this type of meat, one of the strategies is to turn the fish into a practical product, such as the hamburger (Corbo <italic>et al</italic>., <xref ref-type="bibr" rid="cit0009">2008</xref>; Del Nobile <italic>et al</italic>., <xref ref-type="bibr" rid="cit0010">2009</xref>). One of the most questionable parameters of the stability of a fish product is lipid oxidation, due to its composition with high levels of polyunsaturated fatty acids that are more susceptible to oxidation due to the double bonds in the chain, a reaction that occurs even in low temperatures (Soares and Gon&#x00E7;alves, <xref ref-type="bibr" rid="cit0027">2012</xref>; Wu and Mao, <xref ref-type="bibr" rid="cit0030">2008</xref>).</p>
<p>Due to proven importance, the aim of this study is to select and train a panel of assessors specialized in recognizing the rancid defect taste in fish hamburgers and oils and to demonstrate the entire process, emphasizing on the statistical treatment of data.</p>
</sec>
<sec id="sec2" sec-type="materials|methods">
<title>2. MATERIALS AND METHODS</title>
<p>Approved by the Ethics Committee &#x2013; CAAE number 48687815.0.0000.5547 &#x2013; UTFPR, Pato Branco/PR, the study was performed with professors (6), undergraduates (12) and graduate students (8) of UTFPR, 26 subjects in total. The ones involved already had prior contact with the Sensory Analysis discipline facilitating the understanding of the analysis and the terms involved, but none had previously participated of a rancid flavor defect training session. Each assessor performed the analysis in a sensory cabin, properly lit and isolated from the others and from the sample preparation area, with access to a sink for sample disposal and water at will.</p>
<sec id="sec2.1">
<title>2.1. Global performance at selection</title>
<p>The procedure for selection included a previous interview before the difference test addressed to the product (Dutcosky, <xref ref-type="bibr" rid="cit0011">2007</xref>). Questions about allergies and availability for training were made, along with filling in the form required by the Ethics Committee.</p>
<p>The selection of assessors was performed through the triangle test, a modality of sensory analysis called discriminative, which differentiates two samples that received different treatments (ASTM, <xref ref-type="bibr" rid="cit0002">2010</xref>). The probability of accuracy is one-third. It is recommended to use 20 to 40 subjects for a solid result (N&#x00C6;S <italic>et al</italic>., <xref ref-type="bibr" rid="cit0024">2010</xref>).</p>
<p>The test consisted of two samples: rancid and regular sunflower oil. The rancid oil was produced in an oven at 60 &#x00B0;C for 14 days (Houhg and Fiszman, <xref ref-type="bibr" rid="cit0015">2005</xref>) with air circulation, within an open amber glass recipient, with 10% head space. Oils of the same brand were purchased at Pato Branco &#x2013; PR local market. Three samples in random order were presented to the assessors, ten different times, where two samples were equal and they had to identify the different one by circling it. They had to taste it, advised to not smell it or try to differentiate by color somehow. The color was masked by black cups.</p>
<p>The main conditions were kept constant; 15 mL of oil (Borr&#x00E0;s <italic>et al.</italic>, 2015) at 50 &#x00B0;C &#x00B1; 2 &#x00B0;C (Houhg and Fiszman, <xref ref-type="bibr" rid="cit0015">2005</xref>) in a plastic cup of 50 mL, coded with three random digits. Each replicate contained two equal samples oil (regular oil, no rancidity) and a different (rancid) alternating with two equal (rancid) and a different (no rancidity). Warm distilled water kept at 40 &#x00B0;C and plain crackers were provided to clean the palate between samples (Houhg and Fiszman, <xref ref-type="bibr" rid="cit0015">2005</xref>; Borr&#x00E0;s <italic>et al.</italic>, 2015). Each session lasted from 10 to 15 minutes, from 9 am to 12 pm.</p>
<p>The number of correct answers from the assessors so that there was a significant difference between the samples was found in a table based on the chi-square test; if the assessor reached the minimum of correct answers he was selected&#x2013; 10 replicates requires 7 right answers (p &#x003C; 0.05). Another statistical analysis applied to the selection was Wald Sequential Analysis, according to the graphical method (ISO, <xref ref-type="bibr" rid="cit0017">2004</xref>) to further evaluate the assessors approved or rejected, and those who required training (Santana <italic>et al</italic>., <xref ref-type="bibr" rid="cit0025">2006</xref>).</p>
<p>The decision system was obtained through hypothesis testing (ISO, <xref ref-type="bibr" rid="cit0017">2004</xref>) H<sub>o</sub>: p<sub>1</sub> &#x2264; p<sub>0</sub>, and using the values p<sub>0</sub> = 0.33 (probability of a correct response when no perceptible difference exists), p<sub>1</sub> = 0.67 (probability of a correct response when a perceptible difference does exist), for &#x03B1; risk = 0:05 (probability of concluding that a perceptible difference exists when one does not) and &#x03B2; risk = 0.05 (probability of concluding that no perceptible difference exists when one does).</p>
</sec>
<sec id="sec2.2">
<title>2.2. Training process</title>
<p>An unstructured scale of 10 cm was used for training, presented with the numbers 0 and 10 at the extremes (Houhg and Fiszman, <xref ref-type="bibr" rid="cit0015">2005</xref>), where the assessors had a choice of where to place the intensity of the rancid defect of the sample on any point.</p>
<p>The training procedure consisted of three different days/stages of analysis, to calculate the accuracy of the answers and consistency of the team. On each day, four dilutions with rancid oil (0%, 10%, 50% and 100%) were provided to the assessors selected in a sufficient amount of 15mL (Borr&#x00E0;s <italic>et al.</italic>, 2015), using plastic cups coded with random digits with three numbers.</p>
<p>Dilutions of 0% and 100% were presented as the extremes of the scale, where 100% represented the sample at its maximum rancidity (14 days &#x2013; 60 &#x00B0;C) and 0% represented the regular oil sample with no rancidity. The remaining, 10% and 50% dilutions were placed between 0 and 10 cm by assessors, corresponding to little&#x2013;none/much rancid flavor. This procedure was repeated three times within the same day in order to have mean and standard deviations for each day. Each session lasted 10-15 minutes.</p>
</sec>
<sec id="sec2.3">
<title>2.3. Ability to discriminate between dilutions in training</title>
<p>Assuming that samples were only 10% and 50%, a paired test was applied to check whether there was a difference between them, and those who inverted the order of samples on the scale (placed 50% before 10%) had their responses considered incorrect. To check the difference, the bilateral paired test table was consulted (p &#x003C; 0.05) (ASTM, <xref ref-type="bibr" rid="cit0002">2010</xref>).</p>
</sec>
<sec id="sec2.4">
<title>2.4. Individual performance of assessors</title>
<p>The responses were measured in centimeters along the 10 cm scale. ANOVA statistical analysis evaluated individual results, means and standard variations, giving the three days&#x2019; precision using Tukey&#x2019;s mean comparison test (p &#x003C; 0.05) performed by Statistica<sup>&#x00AE;</sup> software 12.7.</p>
</sec>
<sec id="sec2.5">
<title>2.5. Panel performance and homogeneity</title>
<p>Similarly to the individual performance, the mean of each day&#x2019;s responses was calculated, with respective standard deviations, to evaluate panel homogeneity. Assessors that did not differ statistically (p &#x003E; 0.05) from each other, by Tukey&#x2019;s mean comparison test, coinciding in the analysis of both samples, 10% and 50%, were selected for the final trained sensory panel.</p>
</sec>
<sec id="sec2.6">
<title>2.6. Trained panel validation</title>
<p>Validation is important to test the panel reproducibility, which means that if the test is repeated after some time, or by another sensory panel trained exactly as in the present study, the results would not differ significantly (Lea <italic>et al</italic>., <xref ref-type="bibr" rid="cit0020">1995</xref>).</p>
<p>The validation was performed eight times with the products under study, fish burgers which had been stored for 30 days, and soybean oil with two distinct antioxidants. The burgers were made with grass carp fish meat (79.00%), where 33% of the total fatty acids were polyunsaturated (Wu and Mao, <xref ref-type="bibr" rid="cit0030">2008</xref>); ice (10.00%), vegetable fat (5.00%), textured soy protein - TSP (3.00%), spices (2.99%) and BHT (0.01%). The water to hydrate the TSP was discounted from the ice. They were vacuum-packed, and stored under refrigeration until the days of sampling, then frozen each day (initial &#x2013; 0 days; 7, 14, 17, 21, 23, 25 and 30 days).</p>
<p>The burgers were thawed and grilled to serve to the assessors. The samples were cut into uniform sizes of about 1.5 cm<sup>3</sup>, and maintained at 75 &#x00BA;C (internal center) to the time of delivery (Mitterer-Dalto&#x00E9; <italic>et al</italic>. <xref ref-type="bibr" rid="cit0023">2012</xref>) using plastic cups coded with three-digit random numbers. Water at room temperature was provided to clean the mouth between samples.</p>
<p>Samples of soybean oil with the tertiary butylhydroquinone (TBHQ) antioxidant 200 mg/Kg, 100 and 200 mg/Kg of <italic>Quassia amara (Q.a)</italic> extract were tested after 96 hours of rancidity (60 &#x00BA;C &#x2013; oven) to detect any difference among them, regarding the rancid flavor.</p>
<p>An unstructured scale of 10 cm was applied again, for the distribution of burger and oil samples within range (different sheets), anchored in little&#x2013;none/much rancid flavor. ANOVA was applied to the trained team&#x2019;s results to check for differences between samples (p &#x003C; 0.05). The recognition of the difference between samples were compared for equivalence with the training rancid oil to validate the trained panel.</p>
</sec>
</sec>
<sec id="sec3" sec-type="results">
<title>3. RESULTS</title>
<sec id="sec3.1">
<title>3.1. Global performance at selection</title>
<p>Twenty-six people attended the selection (9 males;17 females; ages ranging from 20&#x2013;50), all of which were assessors (A), 15 of which, got seven right responses or more of the ten replicates provided, based on the chi-square table for the triangle discriminatory test, and they were considered suitable for training. By means of Wald Sequential Analysis, eight more assessors were between the acceptance lines (a<sub>x</sub> = 2.0789 + 0.5<italic>n</italic>) and rejection lines (<italic>r</italic><sub>x</sub> = 2.0789 + 0.5<italic>n</italic>). These assessors obtained results that made them eligible for training within the applied statistics. At this point, three people were excluded, as they were found below or at the rejection line (<xref ref-type="fig" rid="f0001">Fig. 1</xref>).</p>
<fig id="f0001">
<label>Figure 1</label>
<caption>
<p>Wald Sequential Analysis for selection of assessors; &#x03B1;=&#x03B2;=0.05; p0 = 0.33; p1 = 0.67.</p>
</caption>
<graphic xlink:href="GYA201733_e203-0107171-g001.tif" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</fig>
</sec>
<sec id="sec3.2">
<title>3.2. Training process, ability to discriminate between dilutions in training</title>
<p>From the 23 assessors selected, 18 agreed to continue the training. According to the unilateral paired test table (p &#x003C; 0.05) 13 assessors should set the right order of sample concentrations, 10% before 50%, in the unstructured 10 cm scale, so that, according to the paired test, the standard dilutions would present significant difference (<xref ref-type="table" rid="t0001">Table 1</xref>) and become standards for the rest of the training process. Fourteen assessors got all the correct orders, verifying significant differences between dilutions.</p>
<table-wrap id="t0001">
<label>Table 1</label>
<caption>
<p>Number of correct responses regarding the order of samples in each triplicate, per day of training</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left">Assessor</th>
<th align="center">Day 1</th>
<th align="center">Day 2</th>
<th align="center">Day 3</th>
<th align="center">Total</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left"><bold>A1, A3, A4, A5, A6, A7, A8, A9, A10, A12, A13, A15, A17, A18</bold></td>
<td align="center" colspan="3">0 &#x2013; Zero. No incorrect answers regarding the order of samples</td>
<td align="center">9</td>
</tr>
<tr>
<td align="left"><bold>A2<xref ref-type="table-fn" rid="tf1-1">&#x002A;</xref>, A16<xref ref-type="table-fn" rid="tf1-1">&#x002A;</xref></bold></td>
<td align="center">3</td>
<td align="center">2</td>
<td align="center">2</td>
<td align="center">7</td>
</tr>
<tr>
<td align="left"><bold>A11<xref ref-type="table-fn" rid="tf1-1">&#x002A;</xref></bold></td>
<td align="center">3</td>
<td align="center">2</td>
<td align="center">3</td>
<td align="center">8</td>
</tr>
<tr>
<td align="left"><bold>A14<xref ref-type="table-fn" rid="tf1-1">&#x002A;</xref></bold></td>
<td align="center">2</td>
<td align="center">3</td>
<td align="center">3</td>
<td align="center">8</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="tf1-1">
<label>&#x002A;</label>
<p>Eliminated</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p>To be approved, the assessors should have shown a total of nine correct responses, which means no change in the order of sample concentrations inside the triplicate, for every day of training.</p>
</sec>
<sec id="sec3.3">
<title>3.3. Individual performance of assessors</title>
<p>According to the results of each assessor, the mean and the standard deviations of the responses were calculated in triplicate for each day of training through ANOVA, with the mean comparison analysis of p-values (Tukey), the mean of the tested three days which assessors presented homogeneity among the days (<xref ref-type="table" rid="t0002">Table 2</xref>).</p>
<table-wrap id="t0002">
<label>Table 2</label>
<caption>
<p>Inter-day precision of the rancid flavor (cm) in 10% and 50% oil dilut&#x00E7;ions</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left">Assessor</th>
<th align="center">Dilution (%)</th>
<th align="center">Day 1</th>
<th align="center">Day 2</th>
<th align="center">Day 3</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left"><bold>A1<xref ref-type="table-fn" rid="tf2-1">&#x002A;</xref></bold></td>
<td align="center">10</td>
<td align="center">3.47<sup>a</sup> &#x00B1; 0.46</td>
<td align="center">3.53<sup>a</sup> &#x00B1; 0,06</td>
<td align="center">1.67<sup>b</sup> &#x00B1; 0.06</td>
</tr>
<tr>
<td align="left"/>
<td align="center">50</td>
<td align="center">8.07<sup>a</sup> &#x00B1; 0.21</td>
<td align="center">8.37<sup>a</sup> &#x00B1; 0.15</td>
<td align="center">6.87<sup>b</sup> &#x00B1; 0.11</td>
</tr>
<tr>
<td align="left"><bold>A3</bold></td>
<td align="center">10</td>
<td align="center">1.70<sup>a</sup> &#x00B1; 0.36</td>
<td align="center">1.07<sup>a</sup> &#x00B1; 0.74</td>
<td align="center">0.37<sup>a</sup> &#x00B1; 0.23</td>
</tr>
<tr>
<td align="left"/>
<td align="center">50</td>
<td align="center">4.33<sup>a</sup> &#x00B1; 2.40</td>
<td align="center">6.30<sup>a</sup> &#x00B1; 1.15</td>
<td align="center">5.83<sup>a</sup> &#x00B1; 4.37</td>
</tr>
<tr>
<td align="left"><bold>A4</bold></td>
<td align="center">10</td>
<td align="center">1.50<sup>a</sup> &#x00B1; 0.30</td>
<td align="center">1.53<sup>a</sup> &#x00B1; 1.10</td>
<td align="center">1.27<sup>a</sup> &#x00B1; 0.68</td>
</tr>
<tr>
<td align="left"/>
<td align="center">50</td>
<td align="center">5.77<sup>a</sup> &#x00B1; 1.42</td>
<td align="center">5.33<sup>a</sup> &#x00B1; 1.15</td>
<td align="center">5.90<sup>a</sup> &#x00B1; 0.66</td>
</tr>
<tr>
<td align="left"><bold>A5</bold></td>
<td align="center">10</td>
<td align="center">2.50<sup>a</sup> &#x00B1; 1.28</td>
<td align="center">3.63<sup>a</sup> &#x00B1; 1.91</td>
<td align="center">4.67<sup>a</sup> &#x00B1; 1.53</td>
</tr>
<tr>
<td align="left"/>
<td align="center">50</td>
<td align="center">5.93<sup>a</sup> &#x00B1; 2.50</td>
<td align="center">6.83<sup>a</sup> &#x00B1; 0.76</td>
<td align="center">6.80<sup>a</sup> &#x00B1; 0.72</td>
</tr>
<tr>
<td align="left"><bold>A6</bold></td>
<td align="center">10</td>
<td align="center">2.23<sup>a</sup> &#x00B1; 0.25</td>
<td align="center">2.03<sup>a</sup> &#x00B1; 0.84</td>
<td align="center">2.13<sup>a</sup> &#x00B1; 0.60</td>
</tr>
<tr>
<td align="left"/>
<td align="center">50</td>
<td align="center">7.30<sup>a</sup> &#x00B1; 0.75</td>
<td align="center">7.47<sup>a</sup> &#x00B1; 0.50</td>
<td align="center">6.93<sup>a</sup> &#x00B1; 0.93</td>
</tr>
<tr>
<td align="left"><bold>A7</bold></td>
<td align="center">10</td>
<td align="center">3.53<sup>a</sup> &#x00B1; 2.15</td>
<td align="center">4.43<sup>a</sup> &#x00B1; 2.18</td>
<td align="center">4.93<sup>a</sup> &#x00B1; 7.20</td>
</tr>
<tr>
<td align="left"/>
<td align="center">50</td>
<td align="center">4.93<sup>a</sup> &#x00B1; 2.41</td>
<td align="center">7.70<sup>a</sup> &#x00B1; 0.62</td>
<td align="center">7.24<sup>a</sup> &#x00B1; 0.80</td>
</tr>
<tr>
<td align="left"><bold>A8</bold></td>
<td align="center">10</td>
<td align="center">3.43<sup>a</sup> &#x00B1; 1.85</td>
<td align="center">3.60<sup>a</sup> &#x00B1; 0.17</td>
<td align="center">1.63<sup>a</sup> &#x00B1; 0.23</td>
</tr>
<tr>
<td align="left"/>
<td align="center">50</td>
<td align="center">7.10<sup>a</sup> &#x00B1; 2.13</td>
<td align="center">7.33<sup>a</sup> &#x00B1; 0.47</td>
<td align="center">7.13<sup>a</sup> &#x00B1; 0.32</td>
</tr>
<tr>
<td align="left"><bold>A9</bold></td>
<td align="center">10</td>
<td align="center">1.50<sup>a</sup> &#x00B1; 0.44</td>
<td align="center">0.93<sup>a</sup> &#x00B1; 0.06</td>
<td align="center">1.03<sup>a</sup> &#x00B1; 0.15</td>
</tr>
<tr>
<td align="left"/>
<td align="center">50</td>
<td align="center">4.73<sup>a</sup> &#x00B1; 0.67</td>
<td align="center">4.00<sup>a</sup> &#x00B1; 0.62</td>
<td align="center">4.73<sup>a</sup> &#x00B1; 0.46</td>
</tr>
<tr>
<td align="left"><bold>A10</bold></td>
<td align="center">10</td>
<td align="center">1.43<sup>a</sup> &#x00B1; 0.31</td>
<td align="center">1.77<sup>a</sup> &#x00B1; 0.67</td>
<td align="center">3.40<sup>a</sup> &#x00B1; 1.40</td>
</tr>
<tr>
<td align="left"/>
<td align="center">50</td>
<td align="center">8.10<sup>a</sup> &#x00B1; 0.78</td>
<td align="center">5.67<sup>a</sup> &#x00B1; 2.75</td>
<td align="center">8.50<sup>a</sup> &#x00B1; 0.87</td>
</tr>
<tr>
<td align="left"><bold>A12</bold></td>
<td align="center">10</td>
<td align="center">2.47<sup>a</sup> &#x00B1; 0.49</td>
<td align="center">2.50<sup>a</sup> &#x00B1; 1.04</td>
<td align="center">2.33<sup>a</sup> &#x00B1; 0.29</td>
</tr>
<tr>
<td align="left"/>
<td align="center">50</td>
<td align="center">5.57<sup>a</sup> &#x00B1; 1.20</td>
<td align="center">5.80<sup>a</sup> &#x00B1; 1.21</td>
<td align="center">5.73<sup>a</sup> &#x00B1; 0.68</td>
</tr>
<tr>
<td align="left"><bold>A13</bold></td>
<td align="center">10</td>
<td align="center">2.93<sup>a</sup> &#x00B1; 0.59</td>
<td align="center">1.63<sup>a</sup> &#x00B1; 0.38</td>
<td align="center">1.77<sup>a</sup> &#x00B1; 1.29</td>
</tr>
<tr>
<td align="left"/>
<td align="center">50</td>
<td align="center">7.10<sup>a</sup> &#x00B1; 0.79</td>
<td align="center">5.40<sup>a</sup> &#x00B1; 2.33</td>
<td align="center">5.87<sup>a</sup> &#x00B1; 1.27</td>
</tr>
<tr>
<td align="left"><bold>A15</bold></td>
<td align="center">10</td>
<td align="center">1.60<sup>a</sup> &#x00B1; 0.53</td>
<td align="center">1.50<sup>a</sup> &#x00B1; 1.21</td>
<td align="center">2.47<sup>a</sup> &#x00B1; 1.27</td>
</tr>
<tr>
<td align="left"/>
<td align="center">50</td>
<td align="center">6.50<sup>a</sup> &#x00B1; 1.50</td>
<td align="center">6.90<sup>a</sup> &#x00B1; 0.10</td>
<td align="center">8.37<sup>a</sup> &#x00B1; 0.85</td>
</tr>
<tr>
<td align="left"><bold>A17</bold></td>
<td align="center">10</td>
<td align="center">2.37<sup>a</sup> &#x00B1; 0,15</td>
<td align="center">2.23<sup>a</sup> &#x00B1; 0.40</td>
<td align="center">2.40<sup>a</sup> &#x00B1; 0.53</td>
</tr>
<tr>
<td align="left"/>
<td align="center">50</td>
<td align="center">6.23<sup>a</sup> &#x00B1; 0.64</td>
<td align="center">6.00<sup>a</sup> &#x00B1; 1.81</td>
<td align="center">5.00<sup>a</sup> &#x00B1; 0.62</td>
</tr>
<tr>
<td align="left"><bold>A18</bold></td>
<td align="center">10</td>
<td align="center">1.17<sup>a</sup> &#x00B1; 0.42</td>
<td align="center">1.57<sup>a</sup> &#x00B1; 0.35</td>
<td align="center">1.43<sup>a</sup> &#x00B1; 0.21</td>
</tr>
<tr>
<td align="left"/>
<td align="center">50</td>
<td align="center">5.57<sup>a</sup> &#x00B1; 0.51</td>
<td align="center">5.60<sup>a</sup> &#x00B1; 0.10</td>
<td align="center">6.10<sup>a</sup> &#x00B1; 0.30</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="tf2-1">
<label>&#x002A;</label>
<p>A1: Eliminated; Same letters in the same line: means do not differ (Tukey p &#x02C3; 0.05).</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p>Assessor A1, whose day 3 differed significantly from the others (p &#x02C2; 0.01), was eliminated at this stage of the statistical analysis. The remaining assessors exhibited homogeneity among days, with no significant differences among means.</p>
<p>For better visualization of this outcome, the F value of ANOVA (one-way) was calculated along with the p-value to test the individual performance of each assessor. F values higher than F<sub>critical</sub> (5.1432) demonstrate significant differences among days of training.</p>
<p>The inability of A1 (F<sub>10</sub> = 45.87 and F<sub>50</sub> = 70.87) was also computed by the F value (<xref ref-type="fig" rid="f0002">Figure 2</xref>) which tested the ability and the homogeneity among the days of the other assessors in training.</p>
<fig id="f0002">
<label>Figure 2</label>
<caption>
<p>Column chart for F values with logarithmic scale (significance level: 5%). The F values were divided by assessors and samples with concentrations of 10% (F10) and 50% (F50).</p>
</caption>
<graphic xlink:href="GYA201733_e203-0107171-g002.tif" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</fig>
</sec>
<sec id="sec3.4">
<title>3.4. Panel performance and homogeneity</title>
<p>The individual performance, in terms of homogeneity among the days and differentiation of samples, removed five assessors thus far. The thirteen remaining were evaluated according to panel homogeneity. Those who did not differ from each other for both samples (rancid oil; 10% and 50% standard solution) were considered part of the final trained panel (Tukey p &#x003E; 0.05; n = 9).</p>
<p>By analyzing the p-values, only seven (A3, A4, A9, A12, A13, A17 and A18) of the thirteen remaining assessors showed homogeneity in their responses (<xref ref-type="table" rid="t0003">Table 3</xref>).</p>
<table-wrap id="t0003">
<label>Table 3</label>
<caption>
<p>Panel consistency for 10% and 50% standard solutions of sunflower rancid oil</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left"/>
<th align="center">10%</th>
<th align="center">50%</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left"><bold>A3</bold></td>
<td align="center"><italic>1.04<sup>c</sup></italic> &#x00B1; <italic>0.67</italic></td>
<td align="center"><italic>5.49<sup>ab</sup></italic> &#x00B1; <italic>1.03</italic></td>
</tr>
<tr>
<td align="left"><bold>A4</bold></td>
<td align="center"><italic>1.43<sup>c</sup></italic> &#x00B1; <italic>0.14</italic></td>
<td align="center"><italic>5.67<sup>ab</sup></italic> &#x00B1; <italic>0.30</italic></td>
</tr>
<tr>
<td align="left"><bold>A5<xref ref-type="table-fn" rid="tf3-1">&#x002A;</xref></bold></td>
<td align="center">3.60<sup>ab</sup> &#x00B1; 1.08</td>
<td align="center">6.52<sup>ab</sup> &#x00B1; 0.52</td>
</tr>
<tr>
<td align="left"><bold>A6<xref ref-type="table-fn" rid="tf3-1">&#x002A;</xref></bold></td>
<td align="center">2.13<sup>bc</sup> &#x00B1; 0.10</td>
<td align="center">7.23<sup>a</sup> &#x00B1; 0.27</td>
</tr>
<tr>
<td align="left"><bold>A7<xref ref-type="table-fn" rid="tf3-1">&#x002A;</xref></bold></td>
<td align="center">4.30<sup>a</sup> &#x00B1; 0.71</td>
<td align="center">6.62<sup>ab</sup> &#x00B1; 1.48</td>
</tr>
<tr>
<td align="left"><bold>A8<xref ref-type="table-fn" rid="tf3-1">&#x002A;</xref></bold></td>
<td align="center">2.88<sup>abc</sup> &#x00B1; 1.09</td>
<td align="center">7.19<sup>a</sup> &#x00B1; 0.13</td>
</tr>
<tr>
<td align="left"><bold>A9</bold></td>
<td align="center"><italic>1.15<sup>c</sup></italic> &#x00B1; <italic>0.30</italic></td>
<td align="center"><italic>4.49<sup>b</sup></italic> &#x00B1; <italic>0.42</italic></td>
</tr>
<tr>
<td align="left"><bold>A10<xref ref-type="table-fn" rid="tf3-1">&#x002A;</xref></bold></td>
<td align="center">2.20<sup>bc</sup> &#x00B1; 1.05</td>
<td align="center">7.42<sup>a</sup> &#x00B1; 1.53</td>
</tr>
<tr>
<td align="left"><bold>A12</bold></td>
<td align="center"><italic>2.43<sup>abc</sup></italic> &#x00B1; <italic>0.09</italic></td>
<td align="center"><italic>5.70<sup>ab</sup></italic> &#x00B1; <italic>0.12</italic></td>
</tr>
<tr>
<td align="left"><bold>A13</bold></td>
<td align="center"><italic>2.11<sup>bc</sup></italic> &#x00B1; <italic>0.71</italic></td>
<td align="center"><italic>6.12<sup>ab</sup></italic> &#x00B1; <italic>0.88</italic></td>
</tr>
<tr>
<td align="left"><bold>A15<xref ref-type="table-fn" rid="tf3-1">&#x002A;</xref></bold></td>
<td align="center">1.85<sup>bc</sup> &#x00B1; 0.53</td>
<td align="center">7.25<sup>a</sup> &#x00B1; 0.98</td>
</tr>
<tr>
<td align="left"><bold>A17</bold></td>
<td align="center"><italic>2.33<sup>bc</sup></italic> &#x00B1; <italic>0.09</italic></td>
<td align="center"><italic>5.74<sup>ab</sup></italic> &#x00B1; <italic>0.65</italic></td>
</tr>
<tr>
<td align="left"><bold>A18</bold></td>
<td align="center"><italic>1.39<sup>c</sup></italic> &#x00B1; <italic>0.20</italic></td>
<td align="center"><italic>5.75<sup>ab</sup></italic> &#x00B1; <italic>0.30</italic></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="tf3-1">
<label>&#x002A;</label>
<p>Eliminated. Same letters in the same column: means do not differ (Tukey p &#x02C3; 0.05).</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p><xref ref-type="fig" rid="f0003">Figures 3</xref> and <xref ref-type="fig" rid="f0004">4</xref> exhibit a graphical representation through box-plots of the variation in assessors&#x2019; behavior, regarding the given dilutions. The trained panel (7 female assessors; ages ranging from 20 to 40) demonstrated proximity to 1 cm of the scale (dilution 10%) and 5cm (50% dilution), 1.70 &#x00B1; 0.58 for 10% standard and 5.57 &#x00B1; 0.51 for 50%. Through box-plot charts, it can be seen that the trained panel presented a combination of factors to be chosen: low variability of data, means (&#x25A1;) in the center of responses and proximity between means and medians (&#x2014;&#x2013;).</p>
<p>Although A3 showed a large standard deviation for the 50% dilution (<xref ref-type="fig" rid="f0004">Fig. 4</xref>), he presented the same consistency with the panel. The assessor with the best results (box-plot and <xref ref-type="table" rid="t0003">Table 3</xref>) was A9, revealing very low data variability, high precision and accuracy. The box-plot not only allows to visualize the behavior of each assessor, but also to behold the influence of each standard used. A better data distribution was found with less variation and values closer to 1 cm for the 10% standard solution of rancid oil (<xref ref-type="fig" rid="f0003">Fig. 3</xref>), which was not observed in the 50% standard.</p>
<fig id="f0003">
<label>Figure 3</label>
<caption>
<p>Box-plot for rancid oil sample diluted to 10%, from three-day training, separated by assessor; N = 9. Means (&#x25A1;); 1&#x2013;99% Range&#x251C;&#x2014;&#x2524;; Medians (&#x2014;&#x2013;).</p>
</caption>
<graphic xlink:href="GYA201733_e203-0107171-g003.tif" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</fig>
<fig id="f0004">
<label>Figure 4</label>
<caption>
<p>Box-plot for rancid oil sample diluted to 50%, from three-day training, separated by assessor; N = 9. Means (&#x25A1;); 1&#x2013;99% Range&#x251C;&#x2015;&#x2524;; Medians (&#x2014;&#x2013;).</p>
</caption>
<graphic xlink:href="GYA201733_e203-0107171-g004.tif" xmlns:xlink="http://www.w3.org/1999/xlink"/>
</fig>
</sec>
<sec id="sec3.5">
<title>3.5. Trained panel validation</title>
<p>The validation of the trained panel was carried out in the analysis of samples: fish hamburgers and soybean oil with <italic>Quassia amara</italic> extract and synthetic antioxidant TBHQ.</p>
<p><xref ref-type="table" rid="t0004">Table 4</xref> shows the equivalence of the rancid taste among samples and standards where burgers H1 and H2 did not differ from each other in rancid taste, nor when compared to H3, H4, H5. However, they showed a significant difference when compared to H6, H7 and H8, the last one considered more pronounced in this parameter. The sample H8, with 30 days of storage under refrigeration, manifested a significant difference with the other days except from the 25<sup>th</sup> and equivalent to the 50% standard. H3, H4 and H5 have a rancid flavor deffect correnponding to a 10% rancid oil standard.</p>
<table-wrap id="t0004">
<label>Table 4</label>
<caption>
<p>Values (mean &#x00B1; standard deviation) for the rancid flavor of samples equivalent to standards</p>
</caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th align="left">Sample</th>
<th align="center">Rancid flavor (cm)</th>
</tr>
</thead>
<tbody>
<tr>
<td align="left"><italic>10% standard</italic></td>
<td align="center"><italic>1.70<sup>deB</sup></italic> &#x00B1; <italic>0.58</italic></td>
</tr>
<tr>
<td align="left"><italic>50% standard</italic></td>
<td align="center"><italic>5.57<sup>abA</sup></italic> &#x00B1; <italic>0.51</italic></td>
</tr>
<tr>
<td align="left">H1 &#x2013; initial</td>
<td align="center">0.00<sup>e</sup> &#x00B1; 0.00</td>
</tr>
<tr>
<td align="left">H2 &#x2013; 7 days</td>
<td align="center">0.16<sup>e</sup> &#x00B1; 0.30</td>
</tr>
<tr>
<td align="left">H3 &#x2013; 14 days</td>
<td align="center">0.76<sup>de</sup> &#x00B1; 0.62</td>
</tr>
<tr>
<td align="left">H4 &#x2013; 17 days</td>
<td align="center">1.54<sup>de</sup> &#x00B1; 1.03</td>
</tr>
<tr>
<td align="left">H5 &#x2013; 21 days</td>
<td align="center">2.30<sup>cde</sup> &#x00B1; 1.46</td>
</tr>
<tr>
<td align="left">H6 &#x2013; 23 days</td>
<td align="center">3.31<sup>bcd</sup> &#x00B1; 2.02</td>
</tr>
<tr>
<td align="left">H7 &#x2013; 25 days</td>
<td align="center">4.77<sup>abc</sup> &#x00B1; 2.60</td>
</tr>
<tr>
<td align="left">H8 &#x2013; 30 days</td>
<td align="center">5.97<sup>a</sup> &#x00B1; 2.67</td>
</tr>
<tr>
<td align="left">Soybean Oil + TBHQ</td>
<td align="center">2.32<sup>B</sup> &#x00B1; 1.75</td>
</tr>
<tr>
<td align="left">Soybean Oil + 100 mg/Kg<italic>Q. a.</italic></td>
<td align="center">2.92<sup>B</sup> &#x00B1; 2.35</td>
</tr>
<tr>
<td align="left">Soybean Oil + 200 mg/Kg<italic>Q. a.</italic></td>
<td align="center">2.10<sup>B</sup> &#x00B1; 2.<sup>19</sup></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn>
<p>Equal letters in the column show that the means do not differ significantly (Tukey p &#x003C; 0.05; n = 7). Capital letters indicate oil samples; lower case letters for burger samples.</p>
</fn>
</table-wrap-foot>
</table-wrap>
<p>The assessors&#x2019; perception showed an equivalent degree of difference in standards and hamburger samples. At the first phase of training it became clear that 10% and 50% standards are different, proving that hamburguers are too. The trained panel was able to find differences equivalent to the training of samples, which have a more complex matrix, and therefore validates the assessors and the method.</p>
<p>For oil samples, after 96 hours in an oven at 60 &#x00B0;C, there was no significant difference among the samples tested (Soybean oil with TBHQ, soybean oil with 100 mg/Kg of <italic>Quassia amara and</italic> soybean oil with 200 mg/Kg of <italic>Quassia amara)</italic> regarding the rancid flavor (<xref ref-type="table" rid="t0003">Table3</xref>). These results demonstrate that the concentration of <italic>Quassia amara</italic> extract used was effective in preventing rancidity, like the synthetic antioxidant. Even the lowest concentration tested, revealing that is possible to use 100 mg/Kg for economic purposes, with a similar effect and no significant difference. Also, it is evident that the rancidity found in all three samples corresponds to the 10% rancid oil standard.</p>
</sec>
</sec>
<sec id="sec4" sec-type="discussion">
<title>4. DISCUSSION</title>
<p>The sequence of analysis applied was efficient for selection, training and panel validation for the rancid taste in oil and fish hamburgers. Wald Sequential Analysis proved to be more effective than the chi-square method for selection, especially since eight important assessors would be automatically excluded already without the Wald test. Each assessor has a different sensitivity for flavors, and the Wald Analysis shows the individual performance graphically, giving a chance to those with potential.</p>
<p>Another point to be emphasized about the Wald Sequencial Analysis is the evaluation of assessors who had acuity at first, but saturated before the end of repetitions, such as A20 who presented saturation on repetitions 5 to 10, performing right only on the 9<sup>th</sup>and even then was selected for training.</p>
<p>As well as the selection, the training also proved to be an important part of the process as established by A1 and A2, both with the best results, 9 correct answers, in the triangle test, but didn&#x2019;t pass through training. This demonstrated the fact that it is possible to have an optimum performance during selection, but not the same happens during the second phase, which confirms the importance of training in order to select a panel.</p>
<p>ANOVA with Tukey mean comparisons represented the means and standard deviations, F value column plot representation, and box-plots completed the statistical analysis and proved effective in the training process. Graphic representations, such as the F value plot and box-plot, provided a better visualization of why only seven were chosen in the end, or why some were eliminated. Tables represented by means and standard deviations seem confusing at times, especially with a larger amount of data.</p>
<p>F values in the table format were used by Braghieri <italic>et al</italic>. (<xref ref-type="bibr" rid="cit0004">2012)</xref> to verify panel agreement for five attributes during a meat evaluation, proving to be an effective method for this purpose, since they found a high level of homogeneity between the panels tested. F values&#x2019; column plot is called a suitable method to compare assessors&#x2019; ability to detect differences between products. ANOVA one-way is the most standard way to treat the raw data (N&#x00E6;s <italic>et al</italic>., <xref ref-type="bibr" rid="cit0024">2010</xref>) and was proven valuable even before, with studies such as Lea <italic>et al</italic>. (<xref ref-type="bibr" rid="cit0020">1995)</xref>, which measured validity in a sensory analysis.</p>
<p>The box-plot in the present work allowed better understanding and visualization in the variation of assessors&#x2019; responses for each standard, also emphasizing the difference between standards. Regarding box-plot graphics, a study by Williamson <italic>et al</italic>. (<xref ref-type="bibr" rid="cit0029">1989)</xref> and Coli <italic>et al</italic>. (<xref ref-type="bibr" rid="cit0008">2015)</xref> mention the importance of the box-plot graphic method to highlight the visualization of data distribution, means and medians, and extreme values, which give a better idea about the response variation than tables.</p>
<p>By means of the box-plot it is noted that the standard deviations shown by 50% dilution (<xref ref-type="fig" rid="f0004">Figure 4</xref>) were higher when compared to the differences shown by 10% dilution (<xref ref-type="fig" rid="f0003">Figure 3</xref>), which emphasizes the perception limit of the judges for rancid taste. There is the possibility that the 50% standard alters or saturates the assessors&#x2019; sensations, as it is near the saturation threshold of the rancid flavor.</p>
<p>Sinesio <italic>et al</italic>. (<xref ref-type="bibr" rid="cit0026">1990)</xref> found a similar intensity of rancid flavor (around 6 cm out of a 9 cm scale) for sausages added with 63.5% rancid fat. In beef steaks, after only 9 days under refrigeration, a nine-assessor trained panel verified 11.4 to 21.4 points, from a 100-point unstructured scale, for rancid flavor (Campo <italic>et al</italic>., <xref ref-type="bibr" rid="cit0007">2006</xref>). This data confirms the rancidity levels found (around 6 out of a 10 cm scale for H8) in the analyzed burger.</p>
<p>For soybean oil, L&#x00F3;pez-Aguilar <italic>et al</italic>. (<xref ref-type="bibr" rid="cit0022">2007)</xref> found 5.89 to 6.58 cm (in a 10-cm scale) for rancid flavor in commercial oils, with 12 weeks of analysis. In this study, trained assessors assigned lower values to the oils with the synthetic antioxidant TBQH and <italic>Quassia amara</italic> extract (100 and 200 mg/Kg) in 96 hours of analysis, confirming the efficiency of the tested antioxidants. Considering the results, because of their composition, the soybean oil and the fish burgers were highly susceptible to oxidation. A trained sensory panel for the rancid flavor would be an appropriate method for quality control, despite the time, effort and money applied.</p>
<p>The validation of the trained panel with a product is essential, because the products&#x2019; matrix is often more complex than the solutions used in the selection and training, and this may confuse the panel. Elortondo <italic>et al</italic>. (<xref ref-type="bibr" rid="cit0012">2007)</xref> and Mitterer-Dalto&#x00E9; <italic>et al</italic>. (<xref ref-type="bibr" rid="cit0023">2012)</xref> validated the sensory panel with a product that recalled the sensation by which the panel had been trained. Elortondo <italic>et al</italic>. (<xref ref-type="bibr" rid="cit0012">2007)</xref> didn&#x2019;t use ANOVA for this purpose, only the percentage, where a sensation mentioned by 66.6% of assessors was considered a parameter, in which they were trained afterwards.</p>
<p>Seven proved to be a good number of trained assessors in the rancid flavor defect case. This number was not explored in depth in the literature, appearing in studies with other flavors and defects in descriptive analyses (Sinesio <italic>et al</italic>., <xref ref-type="bibr" rid="cit0026">1990</xref>; Campo <italic>et al</italic>., <xref ref-type="bibr" rid="cit0007">2006</xref>; L&#x00F3;pez-Aguilar <italic>et al</italic>., <xref ref-type="bibr" rid="cit0022">2007</xref>). The trained panel proved accurate in differentiating samples with the rancid flavor defect according to the combined methods applied. In another study Etaio <italic>et al</italic>.(2010) started a selection for a wine trained panel with 31 assessors, finishing with 13 in the training, ending with seven experts as in the present study, but using only percentages of success; no ANOVA was applied. This proves the difficulty in obtaining a large number of expert assessors.</p>
<p>Because of this difficulty, researchers hire trained panels or use untrained assessors/consumers. Wang <italic>et al</italic>. (<xref ref-type="bibr" rid="cit0028">2012)</xref> used only 4 trained assessors to analyze the tenderness, chewiness and juiciness of pork meat samples. Borr&#x00E1;s <italic>et al</italic>. (<xref ref-type="bibr" rid="cit0006">2015)</xref> used 8 trained assessors to evaluate defects like rancidity and metallic in olive oils. None of the studies trained the assessors; they used a trained panel that already existed. For fish burgers, Corbo <italic>et al</italic>. (<xref ref-type="bibr" rid="cit0009">2008)</xref> and Del Nobile <italic>et al</italic>. (<xref ref-type="bibr" rid="cit0010">2009)</xref> used five and ten untrained assessors, respectively, to determine color, odor, texture, drip loss and general appearance values in the first case and overall quality in the second case.</p>
<p>The International Organization for Standardization usually gives some directions for the selection and training of sensory panels. Companies and universities in some countries follow the methods undergo a lengthy training process to further borrow or rent teams to research, showing that training a panel for a particular research is unusual for the reasons already mentioned. However, according to Resolution CNS/MS 196 (BRASIL, <xref ref-type="bibr" rid="cit0005">1996</xref>) on the conduct of research involving humans in Brazil, the research subject must be free and voluntary, prohibited of any type of compensation, except for personal damages. However, it is possible to outsource the service, receiving only the outcome.</p>
<p>Therefore, the value and importance of a trained panel previously justified, along with the fact that in some countries such as Brazil there is no possibility of hiring a trained panel without third parties involved, or more financial resources, highlights the relevance of the results presented here which detail and discussed the selection and training of a sensory panel.</p>
</sec>
<sec id="sec5" sec-type="conclusions">
<title>5. CONCLUSIONS</title>
<p>It was possible to select and train a panel for the rancid flavor, with seven assessors that were able to distinguish the target products through triangular discriminative analysis, unstructured and hedonic scale, using ANOVA for data statistics, in addition to the Wald Sequential Analysis, box-plot and bar graph for F values. This study is important for other studies that require trained panels, especially if training is necessary because it demonstrated clearly and in a reproducible way, step by step, how to achieve a trained panel.</p>
</sec>
</body>
<back>
<ack>
<title>ACKNOWLEDGMENTS</title>
<p>The authors are grateful to the National Council for Scientific and Technological Development &#x2013; CNPq &#x2013; Brazil (Universal Process n&#x1D52; 456102/2014-0).</p>
</ack>
<ref-list>
<title>REFERENCES</title>
<ref id="cit0001">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ares</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Jaeger</surname>
<given-names>SR</given-names>
</name>
<name>
<surname>Ant&#x00FA;nez</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Vidal</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Gim&#x00E9;nez</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Coste</surname>
<given-names>B</given-names>
</name>
<name>
<surname>Picallo</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Castura</surname>
<given-names>JC</given-names>
</name>
</person-group>
<article-title>Comparison of TCATA and TDS for dynamic sensory characterization of food products</article-title>
<source>Food Res. Int.</source>
<year>2015</year>
<volume>78</volume>
<fpage>148</fpage>
<lpage>158</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.foodres.2015.10.023">http://dx.doi.org/10.1016/j.foodres.2015.10.023</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0002">
<nlm-citation publication-type="standard">
<collab>ASTM</collab>
<source>ASTM &#x2014;Standard Test Method for Sensory Analysis &#x2014; Triangle Test.</source>
<year>2010</year>
<publisher-name>ASTM Int</publisher-name>
<fpage>1</fpage>
<lpage>8</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1520/E1885-04R11">http://dx.doi.org/10.1520/E1885-04R11</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0003">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Banfield</surname>
<given-names>CF</given-names>
</name>
<name>
<surname>Harries</surname>
<given-names>JM</given-names>
</name>
</person-group>
<article-title>A technique for comparing judges&#x2019; performance in sensory tests</article-title>
<source>J. Food Technol.</source>
<year>1975</year>
<volume>10</volume>
<fpage>1</fpage>
<lpage>10</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1111/j.1365-2621.1975.tb00001.x">http://dx.doi.org/10.1111/j.1365-2621.1975.tb00001.x</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0004">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Braghieri</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Piazzolla</surname>
<given-names>N</given-names>
</name>
<name>
<surname>Carlucci</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Monteleone</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Girolami</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Napolitano</surname>
<given-names>F</given-names>
</name>
</person-group>
<article-title>Development and validation of a quantitative frame of reference for meat sensory evaluation</article-title>
<source>Food Qual. Prefer.</source>
<year>2012</year>
<volume>25</volume>
<fpage>63</fpage>
<lpage>68</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.foodqual.2012.01.007">http://dx.doi.org/10.1016/j.foodqual.2012.01.007</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0005">
<nlm-citation publication-type="gov">
<collab>BRASIL</collab>
<source>Diretrizes e normas regulamentadoras de pesquisas envolvendo os seres humanos, in: CNS/MS 196/96.</source>
<year>1996</year>
<publisher-loc>Di&#x00E1;rio Oficial da Rep&#x00FA;blica Federativa do Brasil, Bras&#x00ED;lia, DF</publisher-loc>
<publisher-name>Minist&#x00E9;rio da Sa&#x00FA;de</publisher-name>
</nlm-citation>
</ref>
<ref id="cit0006">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Borr&#x00E1;s</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Mestres</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Ace&#x00F1;a</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Busto</surname>
<given-names>O</given-names>
</name>
<name>
<surname>Ferr&#x00E9;</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Boqu&#x00E9;</surname>
<given-names>R</given-names>
</name>
<name>
<surname>Calvo</surname>
<given-names>A</given-names>
</name>
</person-group>
<article-title>Identification of olive oil sensory defects by multivariate analysis of mid infrared spectra</article-title>
<source>Food Chem.</source>
<year>2015</year>
<volume>187</volume>
<fpage>197</fpage>
<lpage>203</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.foodchem.2015.04.030">http://dx.doi.org/10.1016/j.foodchem.2015.04.030</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0007">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Campo</surname>
<given-names>MM</given-names>
</name>
<name>
<surname>Nute</surname>
<given-names>GR</given-names>
</name>
<name>
<surname>Hughes</surname>
<given-names>SI</given-names>
</name>
<name>
<surname>Enser</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Wood</surname>
<given-names>JD</given-names>
</name>
<name>
<surname>Richardson</surname>
<given-names>RI</given-names>
</name>
</person-group>
<article-title>Flavour perception of oxidation in beef</article-title>
<source>Meat Sci.</source>
<year>2006</year>
<volume>72</volume>
<fpage>303</fpage>
<lpage>311</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.meatsci.2005.07.015">http://dx.doi.org/10.1016/j.meatsci.2005.07.015</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0008">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Coli</surname>
<given-names>MS</given-names>
</name>
<name>
<surname>Gil</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Rangel</surname>
<given-names>P</given-names>
</name>
<name>
<surname>Souza</surname>
<given-names>ES</given-names>
</name>
<name>
<surname>Oliveira</surname>
<given-names>MF</given-names>
</name>
<name>
<surname>Cristina</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Chiaradia</surname>
<given-names>N</given-names>
</name>
</person-group>
<article-title>Chloride concentration in red wines: influence of terroir and grape type</article-title>
<source>Food Sci. Technol.</source>
<year>2015</year>
<volume>35</volume>
<fpage>95</fpage>
<lpage>99</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1590/1678-457X.6493">http://dx.doi.org/10.1590/1678-457X.6493</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0009">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Corbo</surname>
<given-names>MR</given-names>
</name>
<name>
<surname>Speranza</surname>
<given-names>B</given-names>
</name>
<name>
<surname>Filippone</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Granatiero</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Conte</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Sinigaglia</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Del</surname>
<given-names>Nobile</given-names>
</name>
</person-group>
<article-title>Study on the synergic effect of natural compounds on the microbial quality decay of packed fish hamburger</article-title>
<source>Int. J. Food Microbiol.</source>
<year>2008</year>
<volume>127</volume>
<fpage>261</fpage>
<lpage>7</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.ijfoodmicro.2008.07.014">http://dx.doi.org/10.1016/j.ijfoodmicro.2008.07.014</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0010">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Del Nobile</surname>
<given-names>MA</given-names>
</name>
<name>
<surname>Corbo</surname>
<given-names>MR</given-names>
</name>
<name>
<surname>Speranza</surname>
<given-names>B</given-names>
</name>
<name>
<surname>Sinigaglia</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Conte</surname>
<given-names>A</given-names>
</name>
<name>
<surname>Caroprese</surname>
<given-names>M</given-names>
</name>
</person-group>
<article-title>Combined effect of MAP and active compounds on fresh blue fish burger</article-title>
<source>Int. J. Food Microbiol.</source>
<year>2009</year>
<volume>135</volume>
<fpage>281</fpage>
<lpage>287</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.ijfoodmicro.2009.07.024">http://dx.doi.org/10.1016/j.ijfoodmicro.2009.07.024</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0011">
<mixed-citation publication-type="book">
<person-group person-group-type="author">
<name>
<surname>Dutcosky</surname>
<given-names>SD</given-names>
</name>
</person-group>
<source>An&#x00E1;lise sensorial de alimentos.</source>
<year>2007</year>
<edition>2</edition>
<publisher-name>Champagnat</publisher-name>
<publisher-loc>Curitiba</publisher-loc>
</mixed-citation>
</ref>
<ref id="cit0012">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Elortondo</surname>
<given-names>FJP</given-names>
</name>
<name>
<surname>Ojeda</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Albisu</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Salmer&#x00F3;n</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Etayo</surname>
<given-names>I</given-names>
</name>
<name>
<surname>Molina</surname>
<given-names>M</given-names>
</name>
</person-group>
<article-title>Food quality certification: An approach for the development of accredited sensory evaluation methods</article-title>
<source>Food Qual. Prefer.</source>
<year>2007</year>
<volume>18</volume>
<fpage>425</fpage>
<lpage>439</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.foodqual.2006.05.002">http://dx.doi.org/10.1016/j.foodqual.2006.05.002</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0013">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Etaio</surname>
<given-names>I</given-names>
</name>
<name>
<surname>Albisu</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Ojeda</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Gil</surname>
<given-names>PF</given-names>
</name>
<name>
<surname>Salmer&#x00F3;n</surname>
<given-names>J</given-names>
</name>
<name>
<surname>P&#x00E9;rez Elortondo</surname>
<given-names>FJ</given-names>
</name>
</person-group>
<article-title>Sensory quality control for food certification: A case study on wine Panel training and qualification, method validation and monitoring</article-title>
<source>Food Cont.</source>
<year>2010</year>
<volume>21</volume>
<fpage>542</fpage>
<lpage>548</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.foodcont.2009.08.011">http://dx.doi.org/10.1016/j.foodcont.2009.08.011</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0014">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Gonz&#x00E1;lez</surname>
<given-names>MM</given-names>
</name>
<name>
<surname>Navarro</surname>
<given-names>T</given-names>
</name>
<name>
<surname>G&#x00F3;mez</surname>
<given-names>G</given-names>
</name>
<name>
<surname>P&#x00E9;rez</surname>
<given-names>RA</given-names>
</name>
<name>
<surname>de Lorenzo</surname>
<given-names>C</given-names>
</name>
</person-group>
<article-title>Sensory assessment of table olive: I. Set up of a panel test and use of standarised scales</article-title>
<source>Grasas Aceites</source>
<year>2007</year>
<volume>58</volume>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3989/gya.2007.v58.i3.176">http://dx.doi.org/10.3989/gya.2007.v58.i3.176</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0015">
<mixed-citation publication-type="book">
<person-group person-group-type="author">
<name>
<surname>Houhg</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Fiszman</surname>
<given-names>S</given-names>
</name>
</person-group>
<source>Estimaci&#x00F3;n de la vida &#x00FA;til sensoria de los alimentos</source>
<year>2005</year>
<edition>1</edition>
<publisher-name>Mart&#x00ED;n Impresores, S. L.</publisher-name>
<publisher-loc>Valencia - Espanha</publisher-loc>
</mixed-citation>
</ref>
<ref id="cit0016">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Ibrahim</surname>
<given-names>HMA</given-names>
</name>
</person-group>
<article-title>Acceleration of curing period of pastrami manufactured from buffalo meat: II-Fatty acids, amino acids, nutritional value and sensory evaluation</article-title>
<source>Grasas Aceites</source>
<year>2001</year>
<volume>52</volume>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3989/gya.2001.v52.i2.382">http://dx.doi.org/10.3989/gya.2001.v52.i2.382</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0017">
<nlm-citation publication-type="gov">
<collab>ISO</collab>
<source><italic>Sensory analysis - Methodology - Sequential analysis</italic>, in: ISO 16820:2004.</source>
<year>2004</year>
<publisher-loc>New York</publisher-loc>
<publisher-name>ANSI</publisher-name>
<fpage>10</fpage>
</nlm-citation>
</ref>
<ref id="cit0018">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Kamruzzaman</surname>
<given-names>M</given-names>
</name>
<name>
<surname>ElMasry</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Sun</surname>
<given-names>DW</given-names>
</name>
<name>
<surname>Allen</surname>
<given-names>P</given-names>
</name>
</person-group>
<article-title>Non-destructive assessment of instrumental and sensory tenderness of lamb meat using NIR hyperspectral imaging</article-title>
<source>Food Chem.</source>
<year>2013</year>
<volume>141</volume>
<fpage>389</fpage>
<lpage>396</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.foodchem.2013.02.094">http://dx.doi.org/10.1016/j.foodchem.2013.02.094</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0019">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Latreille</surname>
<given-names>J</given-names>
</name>
<name>
<surname>Mauger</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Ambroisine</surname>
<given-names>L</given-names>
</name>
<name>
<surname>Tenenhaus</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Vincent</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Navarro</surname>
<given-names>S</given-names>
</name>
<name>
<surname>Guinot</surname>
<given-names>C</given-names>
</name>
</person-group>
<article-title>Measurement of the reliability of sensory panel performances</article-title>
<source>Food Qual. Prefer.</source>
<year>2006</year>
<volume>17</volume>
<fpage>369</fpage>
<lpage>375</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.foodqual.2005.04.010">http://dx.doi.org/10.1016/j.foodqual.2005.04.010</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0020">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lea</surname>
<given-names>P</given-names>
</name>
<name>
<surname>R&#x00F3;dbotten</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Naes</surname>
<given-names>T</given-names>
</name>
</person-group>
<article-title>Measuring validity in sensory analysis</article-title>
<source>Food Qual. Prefer.</source>
<year>1995</year>
<volume>6</volume>
<fpage>321</fpage>
<lpage>326</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/0950-3293(95)00036-4">http://dx.doi.org/10.1016/0950-3293(95)00036-4</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0021">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Lee</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Choe</surname>
<given-names>E</given-names>
</name>
</person-group>
<article-title>Changes in oxidation-derived off-flavor compounds of roasted sesame oil during accelerated storage in the dark</article-title>
<source>Biocatal. Agric. Biotechnol.</source>
<year>2012</year>
<volume>1</volume>
<fpage>89</fpage>
<lpage>93</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.bcab.2011.08.003">http://dx.doi.org/10.1016/j.bcab.2011.08.003</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0022">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>L&#x00F3;pez-Aguilar</surname>
<given-names>JR</given-names>
</name>
<name>
<surname>Valerio-Alfaro</surname>
<given-names>G</given-names>
</name>
<name>
<surname>Monroy-Rivera</surname>
<given-names>JA</given-names>
</name>
<name>
<surname>Medina-Ju&#x00E1;rez</surname>
<given-names>LA</given-names>
</name>
<name>
<surname>O&#x2019;Mahony</surname>
<given-names>M</given-names>
</name>
<name>
<surname>Angulo</surname>
<given-names>O</given-names>
</name>
</person-group>
<article-title>Evaluation of a simple and sensitive sensory method for measuring rancidity in soybean oils</article-title>
<source>Grasas Aceites</source>
<year>2007</year>
<volume>57</volume>
<fpage>149</fpage>
<lpage>154</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3989/gya.2006.v57.i2.30">http://dx.doi.org/10.3989/gya.2006.v57.i2.30</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0023">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Mitterer-Dalto&#x00E9;</surname>
<given-names>ML</given-names>
</name>
<name>
<surname>Treptow</surname>
<given-names>R</given-names>
</name>
<name>
<surname>De</surname>
<given-names>O</given-names>
</name>
<name>
<surname>Martins</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Martins VM</surname>
<given-names>V</given-names>
</name>
<name>
<surname>Queiroz</surname>
<given-names>MI</given-names>
</name>
</person-group>
<article-title>Selecting and Training a Panel to Evaluate the Metallic Sensation of Meat</article-title>
<source>Food Sci. Technol. Res.</source>
<year>2012</year>
<volume>18</volume>
<fpage>279</fpage>
<lpage>286</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3136/fstr.18.279">http://dx.doi.org/10.3136/fstr.18.279</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0024">
<mixed-citation publication-type="book">
<person-group person-group-type="author">
<name>
<surname>N&#x00E6;s</surname>
<given-names>T</given-names>
</name>
<name>
<surname>Brockhoff</surname>
<given-names>PB</given-names>
</name>
<name>
<surname>Tomic</surname>
<given-names>O</given-names>
</name>
</person-group>
<source>Statistics for Sensory and Consumer Science</source>
<year>2010</year>
<publisher-name>Wiley</publisher-name>
<publisher-loc>Chichester</publisher-loc>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1002/9780470669181">http://dx.doi.org/10.1002/9780470669181</ext-link>
</comment>
</mixed-citation>
</ref>
<ref id="cit0025">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Santana</surname>
<given-names>LRR</given-names>
</name>
<name>
<surname>Santos</surname>
<given-names>LCS</given-names>
</name>
<name>
<surname>Natalicio</surname>
<given-names>MA</given-names>
</name>
<name>
<surname>Mondragon-Bernals</surname>
<given-names>OL</given-names>
</name>
<name>
<surname>Elias</surname>
<given-names>EM</given-names>
</name>
<name>
<surname>Silva</surname>
<given-names>CB</given-names>
</name>
<name>
<surname>Zepka</surname>
<given-names>LQ</given-names>
</name>
<name>
<surname>Martins</surname>
<given-names>ISL</given-names>
</name>
<name>
<surname>Vernaza</surname>
<given-names>MG</given-names>
</name>
<name>
<surname>Castillo-Pizarro</surname>
<given-names>C</given-names>
</name>
<name>
<surname>Bolini</surname>
<given-names>HMA</given-names>
</name>
</person-group>
<article-title>Perfil sensorial de iogurte light, sabor p&#x00EA;ssego</article-title>
<source>Ci&#x00EA;ncia e Tecnol. Aliment.</source>
<year>2006</year>
<volume>26</volume>
<fpage>619</fpage>
<lpage>625</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1590/S0101-20612006000300021">http://dx.doi.org/10.1590/S0101-20612006000300021</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0026">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Sinesio</surname>
<given-names>F</given-names>
</name>
<name>
<surname>Risvik</surname>
<given-names>E</given-names>
</name>
<name>
<surname>Rodbotten</surname>
<given-names>M</given-names>
</name>
</person-group>
<article-title>Evaluation of panelist performance in descriptive profiling of rancid sausages: a multivariate study</article-title>
<source>J. Sens. Stud.</source>
<year>1990</year>
<volume>5</volume>
<fpage>33</fpage>
<lpage>52</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1111/j.1745-459X.1990.tb00480.x">http://dx.doi.org/10.1111/j.1745-459X.1990.tb00480.x</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0027">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Soares</surname>
<given-names>KMP</given-names>
</name>
<name>
<surname>Gon&#x00E7;alves</surname>
<given-names>AA</given-names>
</name>
</person-group>
<article-title>Qualidade e seguran&#x00E7;a do pescado</article-title>
<source>Rev. Inst. Adolfo Lutz</source>
<year>2012</year>
<volume>71</volume>
<fpage>1</fpage>
<lpage>10</lpage>
</nlm-citation>
</ref>
<ref id="cit0028">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wang</surname>
<given-names>Q</given-names>
</name>
<name>
<surname>Lonergan</surname>
<given-names>SM</given-names>
</name>
<name>
<surname>Yu</surname>
<given-names>C</given-names>
</name>
</person-group>
<article-title>Rapid determination of pork sensory quality using Raman spectroscopy</article-title>
<source>Meat Sci.</source>
<year>2012</year>
<volume>91</volume>
<fpage>232</fpage>
<lpage>239</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.meatsci.2012.01.017">http://dx.doi.org/10.1016/j.meatsci.2012.01.017</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0029">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Williamson</surname>
<given-names>DF</given-names>
</name>
<name>
<surname>Parker</surname>
<given-names>RA</given-names>
</name>
<name>
<surname>Kendrick</surname>
<given-names>JS</given-names>
</name>
</person-group>
<article-title>The box plot: A simple visual method to interpret data</article-title>
<source>Ann. Intern. Med.</source>
<year>1989</year>
<volume>110</volume>
<fpage>916</fpage>
<lpage>921</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.7326/0003-4819-110-11-916">http://dx.doi.org/10.7326/0003-4819-110-11-916</ext-link>
</comment>
</nlm-citation>
</ref>
<ref id="cit0030">
<nlm-citation publication-type="journal">
<person-group person-group-type="author">
<name>
<surname>Wu</surname>
<given-names>T</given-names>
</name>
<name>
<surname>Mao</surname>
<given-names>L</given-names>
</name>
</person-group>
<article-title>Influences of hot air drying and microwave drying on nutritional and odorous properties of grass carp (<italic>Ctenopharyngodon idellus</italic>) fillets</article-title>
<source>Food Chem.</source>
<year>2008</year>
<volume>110</volume>
<fpage>647</fpage>
<lpage>653</lpage>
<comment>
<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.1016/j.foodchem.2008.02.058">http://dx.doi.org/10.1016/j.foodchem.2008.02.058</ext-link>
</comment>
</nlm-citation>
</ref>
</ref-list>
</back>
</article>
