USF Information Science Blog

This week, we were asked to outline the following in an RMarkdown:

• Create a new Markdown file using R programming.
• Focus specifically on the main functions you are developing for your final project.
• Describe each function in detail within the Markdown file. Explain the purpose, inputs, outputs, and any additional relevant information.
• Utilize Markdown formatting to present your content in a clear and organized manner.
• Include code snippets or examples within the Markdown file to illustrate how the functions work.

I will say, the resource outlining RMarkdown syntax was very much appreciated! I didn’t need it much for this assignment, but that would have been a life saver last semester when I was struggling to format some other final projects. I had to learn a alot of RMarkdown syntax by trial and error based on my CSS knowledge, so I will definently be saving that!

For my package, openEvalR, I decided to create 4 functions: results() to extract model evaluation results from evaluation reports, metadata() to extract the original dataset uploaded to OpenAI as well as the data_source_idx, kappas() to caluclate the Kappa between the model results and specified ground-truth, and cmatrix() to generate a caret::confusion matrix for each model test.

I will note that these tools are primarily being developed in order to aid the current research study I am working with (We are bringing a poster to FLAIRS 38!), but I hope that it helps someone else with parsing OpenAI’s evaluation results!

Link to my Github: Here