Определение
Reliabilityisreliability,whichreferstothedegreetowhichtheresultsobtainedareconsistentwhenthesamemethodisusedtorepeatedlymeasurethesameobject.Ontheotherhand,reliabilityreferstothereliabilityofmeasurementdata.
Forexample,forthefirstquestionofthefirstpartofthe"LibraryUtilizationandSatisfactionQuestionnaire",ifyouaskthesamequestion3daysapartfromthesameperson,ifyouansweritforthefirsttime,youwillbeTheinvestigatorchoosesA,thesecondanswerchoosesC,andthethirdanswerchoosesD,whichmeansthatthereliabilityofthesurveyresultsforthisquestionislow,becausethesurveyresultsarequitedifferent.Ifthesameanswerisselectedthreetimesortheanswerwithsmalldifferencesisselected,itmeansthatthereliabilityofthesurveyresultsishighundertheconditionofexcludingsystematicerrors.
Формула
Ifisusedtoindicatethetruevalue,indicatesthatthedeviationisthesystematicerror,representstherandomerrorofthemeasurement,representsthemeasurementresult,thereare:
Intheabovedecompositionformula,isanabstractvariable,apotentialvaluethatneedstobeestimated.Systemerrorisanerrorthatcanbeavoidedorreducedbyadoptingcertainmeans,whilerandomerrorisunavoidable.
Ако измереният резултат е в съответствие с истинската стойност или разликата е малка, измерването се определя като "надеждно" или "надеждно"; В противен случай измерването се определя като "ненадеждно" или "ненадеждно" до известна степен.
Becausethesystematicerrorisdifficulttodecompose,andthequestionnairedesignrequirestoavoidsystematicerrorsasmuchaspossible,sousuallyonlyrandomerrorsareconsideredinthereliabilityanalysis.Thatis,onthebasisofthefollowingformula,analyzethereliabilityofthequestionnaire:
Коефициент на надеждност
Преглед
Forrandomerrors,itisgenerallyassumedthattheexpectedvalue(averagevalue)is0andisindependentofthetruevalue.Underthisassumption,thereare:
Sinceandareindependentofeachother,therearethefollowingformulas:
VisiblemeasurementvaluesThevarianceisequaltothesumofthetruevaluevarianceandtheerrorvariance,andandTherelativesizeofcanbeusedtodescribethecredibilityofthesurveyresults.Thelargerthemeasurement,thelargertherandomerrorandthelowerthereliabilityofthemeasurement.Weusethereliabilitycoefficienttoexpressthedegreeofreliability.
Определение
Thereliabilitycoefficientofthequestionnaireisdefinedas:thevarianceofthetruevaluethevarianceofthemeasuredvalue
ordefinedas:
Thelarger,Indicatingthegreaterthecredibilityofthequestionnaire.
Недостатъци
Fromtheabovereliabilitycalculationformula,asitinvolvesthesumofsquaresoferrors,itisnecessarytorepeatmultipletimesforthesamesurveyobject.Measurement,onthebasisofestimatingthevaluesofand,thereliabilityestimatecanbeobtained.However,multipleretestswillbringaboutmemoryeffectandconnectioneffect,andwillcauseobjectiontothesurveyed,soitismoredifficulttoachieveinsurveyresearch.
Оценка на надеждността
Beforeestimatingthereliabilityofthequestionnaire,itisnecessarytouseanappropriatescale(suchasLikertscale)toAllkindsofsubjectiveorobjectivealternativeanswersintheareconvertedintodigitalform,andthenthequestionnaireisscoredonthisbasis(includingindividualscores,groupscoresofrelatedtopics,andtotalscores,etc.).
Thecommonlyusedspecificmethodsofreliabilityanalysisincludetest-retestreliability,duplicatereliability,split-halfreliability,andreliabilitycoefficientmethods(thelattertwocanbeclassifiedasВътрешна последователност надеждност).
Тест-повторна надеждност
Тест-повторна надеждност(test-retestreliability)isalsocalledtest-retestreliability.Itusesthesamequestionnaireforthesamegroupofrespondents.Thesurveywasconductedtwiceatdifferenttimepoints,andthedegreeofdifferencebetweenthetwosurveyresults.Thetest-retestreliabilityreflectstheinfluenceofrandomerrors.
Thesourceoftheerrorexaminedinthetest-retestreliabilityistherandominfluencebroughtaboutbythechangeoftime.Whenassessingthereliabilityofretests,wemustpayattentiontothetimebetweenretests.Forpersonalitytests,theintervalbetweenretestsisbetweentwoweeksandsixmonths.
Whenevaluatingtest-retestreliability,youshouldalsopayattentiontothefollowingtwoimportantissues:(1)Тест-повторна надеждностgenerallyonlyreflectschangescausedbyrandomfactors,anddoesnotreflectlong-termchangesinsubjects’behavior.⑵Differentbehaviorsareaffecteddifferentlybyrandomerrors.
Disadvantage:Retestreliabilityhasadilemma.Shorteningthetimeintervalbetweentwotestsmakesiteasierforthesubjecttorecallthetestquestions;whileextendingthetimeintervalbetweenthetwotests,thesubjectismoresusceptibletochangesinexternalinfluences.
Надеждност на паралелни форми
Надеждност на паралелни форми,alsoknownasequivalencecoefficient,isakindofEquivalenceReliability,Referstothedegreeofvariationofthequestionnairesurveyresultscomparedtoanotherverysimilarquestionnairesurveyresult.Itusestwoquestionnaireswithequivalentcontentbutdifferenttopicsforthesamegroupofrespondents,andthencomparesthedegreeofcorrelationbetweenthetwosetsofdata.
Itismoreworkloadthanretestingreliability,becausethesamemeasurementtool(questionnaire,mentalscale,etc.)needstoconstructtwoequivalentcopies,andthetwocopiesshouldcontainthesameamount,Type,content,difficultyofthetopic.Toassessthereliabilityofacopy,twocopiesareusedtotestthesamegroupofsubjects,andthenthecorrelationcoefficientofthemeasurementscoresofthetwocopiesisestimated.Thelargerthecorrelationcoefficient,thesmallerthevariationcausedbythecompositionofthetwocopies.Thisisdifferentfromthevariationcausedbyconsideringtimeinthereliabilityofretestingstability.Thatistosay,thecorrelationcoefficientreflectsthedegreeofequivalenceofthemeasuredscores,sothereplicareliabilityisalsocalledtheequivalencereliability.
Themainadvantagesofreplicareliabilityare:⑴Itcanavoidsomeproblemsofretestreliability,suchasmemoryeffect,practiceeffect,etc.;⑵Suitableforlong-termfollow-upresearchorinvestigationofsomeinterferencevariablesonthetestAchievementimpact;⑶reducethepossibilityofcounselingorcheating.☆Thelimitationsofreplicareliabilityare:(1)Ifthemeasuredbehaviorissusceptibletopractice,thereplicareliabilitycanonlybereducedbutnoteliminated;(2)thenatureofsometestswillchangeduetorepetition;(3)someItisdifficulttofindasuitablecopyofthetest.
Вътрешна последователност надеждност
Itmainlyreflectstherelationshipbetweentheinternalquestionsofthetest,andexamineswhethereachitemofthetestmeasuresthesamecontentorcharacteristics.Вътрешна последователност надеждностisdividedintohalf-halfreliabilityandhomogeneityreliability.
1,Split-halfreliability(split-halfreliability)referstothedegreeofvariationintheresultsofthetwohalvesofthequestionnaireinasurvey.isthereliabilitycoefficientobtainedbydividingthetestintotwohalvesandcalculatingthecorrelationbetweenthetwohalvesofthetest.Thelongerthetest,thehigherthereliabilitycoefficient.ThecorrectionformulaistheSpearman-Brownformula.Spearman-Brownformulaisanempiricalformulaforcorrectingsplit-halfreliability(rtt=2rhh/(1+rhh)Generallyspeaking,ifthetestisdividedintotwohalves,thesplittingcoefficientrttis0.5)
Itshypothesisisthatthevarianceofthetestscoresinthetwohalvesareequal.Whenthehypothesisisnotvalid,oneoftheFlanaganformulaorthekulonformulacanbeusedtodirectlyobtainthereliabilitycoefficientofthetest.
2,Homogeneityreliabilityreferstotheextenttowhicheachiteminthetestexaminesthesamecontent.Whenthereliabilityofhomogeneityislow,eventhougheachtestitemseemstomeasurethesametrait,thetestisactuallyheterogeneous,thatis,thetestmeasuresmorethanonetrait.Thehomogeneityanalysisissimilartotheinternalconsistencyanalysisintheprojectanalysis.Severalformulasforcalculatinghomogeneityreliability:(1)Kudd-Richardsonformula(2)Cronbachalphacoefficient.Forsomecomplexandheterogeneouspsychologicalvariables,itisnotfeasibletouseasinglehomogeneitytest,soseveralrelativelyheterogeneoussubtestsareoftenused.
Относителна надеждност
referstotheconsistencyofdifferentratersinevaluatingthesameobject.Thesimplestestimationmethodistorandomlyselectanumberofanswersheets,scorethembytwoindependentraters,andthenfindthecorrelationcoefficientofthetwojudgescoresforeachanswersheet.Thecalculationofthiscorrelationcoefficientcanusetheproduct-differencecorrelationmethod,ortheSpearmanrankcorrelationmethod.
Връзка между надеждност и валидност
Therearenotonlyobviousdifferencesbetweenthereliabilityandvalidityofthequestionnaire,buttherearealsomutualconnectionsandmutualconstraints.Reliabilitymainlyanswersquestionsaboutconsistency,stabilityandreliabilityofmeasurementresults;validitymainlyanswersquestionsaboutvalidityandcorrectnessofmeasurementresults.
TherelationshipbetweenvalidityandreliabilitycanbeunderstoodbytheformulaO=TSRthatconstitutesthemeasuredvalue.Ifthemeasurementiscompletelyvalid,thatis,0=T,S=0,R=0,themeasurementmustbecompletelycredibleatthistime.Ifthereliabilityofthescaleisinsufficient,itmaynotbecompletelyvalid,becauseO=TR.Ifthescaleiscompletelycredible,itcanbecompletelyeffective,oritmaynotbe,becausetheremaybeerrorsthatmayleadtoerrors.Althoughlackofreliabilitynecessarilylacksvalidity,thedegreeofreliabilitydoesnotreflectthedegreeofvalidity.Reliabilityisanecessaryconditionforvalidity,butnotasufficientcondition.Fromatheoreticalpointofview,thequantityshouldhavesufficientvalidityandreliability;fromapracticalpointofview,agoodscaleshouldalsobepractical.Practicalityreferstotheeconomy,convenienceandinterpretabilityofthescale.
Generallyspeaking,reliabilityisanecessaryconditionforvalidity,thatis,validitymustbeestablishedonthebasisofreliability;butthereisnomeasureofvalidity,evenifitsreliabilityishigh,Suchameasurementisalsomeaningless.Връзка между надеждност и валидностhasthefollowingtypes:
①Надежден и ефективен
Thiskindofquestionnaireaccuratelyreflectsthetrueattitudeofthesurveyedperson.ThequestioninthequestionnaireisCloselyrelatedtothetargetoftheinvestigation.ThissituationisshowninFigure8-8(a).Thesolidpoint(x,y)inthefigurerepresentsthetruesituationofthephenomenontobemeasured,andtheremainingpointsrepresentthemeasurementresultsobtainedafterinvestigation.Ifthesurveyresultscantrulyreflectthesurveyedobjectsandthemeasurementerrorissmall,itmeansthattheresultsofthequestionnairesurveyarecredibleandeffective.
②Достоверен, но невалиден
Althoughtheresultsofthiskindofquestionnairecanaccuratelyreflectthetrueattitudesoftherespondents,thequestionnairehasaweakcorrelationwiththerealpurposeofthesurvey,Inconsistentwiththeobjectivesoftheinvestigation.AsshowninFigure8-8(b).Thissituationshowsthatalthoughtheresultsobtainedinthesurveyarecredible,theremaybeerrorsinsomelinks.Forexample,thedesignofthequestionsinthequestionnairecausedallthesurveyedpersonneltohaveadeviationinunderstanding,whichresultedinasystem.Sexualdeviation.
③Ненадежден и невалиден
Inthiscase,theresultsofstatisticalsurveysarescattered,anditisdifficulttoobtaineffectiveresultsfromthequestionnaires.Thisisthemeasurementapplication.Typestoavoid.AsshowninFigure8-8(c).