SQL類的度量指標是指運行SQL后的結果和預期之間的一個度量值。
datacompy score
datacompy score 使用DataCompy(一個比較pandas的數據格式的python類,所以需要按照datacompy:pip install datacompy),默認是按照rows比較,也可以設置按照columns比較,這個事通過mode參數配置。默認的采用f1也可以通過metric配置recall。
from ragas.dataset_schema import SingleTurnSample
from ragas.metrics import DataCompyScoreimport asyncio
async def main():
# from ragas.dataset_schema import SingleTurnSampledata1 = """acct_id,dollar_amt,name,float_fld,date_fld10000001234,123.45,George Maharis,14530.1555,2017-01-0110000001235,0.45,Michael Bluth,1,2017-01-0110000001236,1345,George Bluth,,2017-01-0110000001237,123456,Bob Loblaw,345.12,2017-01-0110000001238,1.05,Lucille Bluth,,2017-01-0110000001238,1.05,Loose Seal B