Skip to content

Commit

Permalink
Built site for gh-pages
Browse files Browse the repository at this point in the history
  • Loading branch information
@tosaddler
tosaddler committed Aug 1, 2024
1 parent 54d5683 commit 39a52f9
Show file tree
Hide file tree
Showing 28 changed files with 1,896 additions and 208 deletions.
2 changes: 1 addition & 1 deletion .nojekyll
View file
Original file line number Diff line number Diff line change
@@ -1 +1 @@
a2a9a405
23d71b4e
15 changes: 10 additions & 5 deletions ai/automated-llm-evaluation.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@

<meta name="viewport" content="width=device-width, initial-scale=1.0, user-scalable=yes">

<meta name="dcterms.date" content="2024-07-09">
<meta name="description" content="Running automated large language model (LLM) testing using Promptfoo.">

<title>Automated LLM Evaluation – NIEHS Scientific Developers Guide</title>
<style>
Expand Down Expand Up @@ -190,18 +190,23 @@ <h2 id="toc-title">On this page</h2>
<h1 class="title">Automated LLM Evaluation</h1>
</div>

<div>
<div class="description">
Running automated large language model (LLM) testing using Promptfoo.
</div>
</div>


<div class="quarto-title-meta">



<div>
<div class="quarto-title-meta-heading">Published</div>
<div class="quarto-title-meta-heading">Modified</div>
<div class="quarto-title-meta-contents">
<p class="date">July 9, 2024</p>
<p class="date-modified">July 9, 2024</p>
</div>
</div>


</div>

Expand All @@ -212,7 +217,7 @@ <h1 class="title">Automated LLM Evaluation</h1>

<section id="introduction" class="level2">
<h2 class="anchored" data-anchor-id="introduction">Introduction</h2>
<p>This page shows how to run automated LLM testing. If you are part of the NIEHS Github organization, you can see an example of this in the <a href="https://github.com/NIEHS/ToxPipe-Model-Comparison/tree/main/reports/ecsa-gara-challenge">NIEHS/ToxPipe-Model-Comparisons repository</a>.</p>
<p>This page shows how to run automated LLM testing. If you are part of the <a href="https://github.com/NIEHS">NIEHS GitHub</a> organization, you can see an example of this in the <a href="https://github.com/NIEHS/ToxPipe-Model-Comparison/tree/main/reports/ecsa-gara-challenge">NIEHS/ToxPipe-Model-Comparisons</a> repository.</p>
</section>
<section id="requirements" class="level2">
<h2 class="anchored" data-anchor-id="requirements">Requirements</h2>
Expand Down
15 changes: 7 additions & 8 deletions ai/coding-assistants.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,6 @@

<meta name="viewport" content="width=device-width, initial-scale=1.0, user-scalable=yes">

<meta name="dcterms.date" content="2024-07-27">

<title>Coding Assistants – NIEHS Scientific Developers Guide</title>
<style>
Expand Down Expand Up @@ -143,8 +142,8 @@ <h2 id="toc-title">On this page</h2>

<ul>
<li><a href="#introduction" id="toc-introduction" class="nav-link active" data-scroll-target="#introduction">Introduction</a></li>
<li><a href="#github-copilot" id="toc-github-copilot" class="nav-link" data-scroll-target="#github-copilot">GitHub Copilot</a></li>
<li><a href="#continue.dev-vscode-plugin" id="toc-continue.dev-vscode-plugin" class="nav-link" data-scroll-target="#continue.dev-vscode-plugin">Continue.dev VSCode Plugin</a></li>
<li><a href="#github-copilot" id="toc-github-copilot" class="nav-link" data-scroll-target="#github-copilot"><iconify-icon inline="" icon="logos:github-icon" aria-label="Icon github-icon from logos Iconify.design set." title="Icon github-icon from logos Iconify.design set."></iconify-icon> GitHub Copilot</a></li>
<li><a href="#continue.dev-vscode-plugin" id="toc-continue.dev-vscode-plugin" class="nav-link" data-scroll-target="#continue.dev-vscode-plugin"><img src="../media/continue-logo.png" style="height:1em"> Continue.dev VSCode Plugin</a></li>
</ul>
</nav>
</div>
Expand All @@ -161,13 +160,13 @@ <h1 class="title">Coding Assistants</h1>
<div class="quarto-title-meta">



<div>
<div class="quarto-title-meta-heading">Published</div>
<div class="quarto-title-meta-heading">Modified</div>
<div class="quarto-title-meta-contents">
<p class="date">July 27, 2024</p>
<p class="date-modified">July 27, 2024</p>
</div>
</div>


</div>

Expand All @@ -182,11 +181,11 @@ <h2 class="anchored" data-anchor-id="introduction">Introduction</h2>
<p>This guide is intended to provide a set of best practices and guidelines for using coding assistants in your development workflow. Coding assistants are tools that help you write code more efficiently and effectively by providing suggestions, auto-completions, and other features that streamline the coding process.</p>
</section>
<section id="github-copilot" class="level2">
<h2 class="anchored" data-anchor-id="github-copilot">GitHub Copilot</h2>
<h2 class="anchored" data-anchor-id="github-copilot"><iconify-icon inline="" icon="logos:github-icon" aria-label="Icon github-icon from logos Iconify.design set." title="Icon github-icon from logos Iconify.design set."></iconify-icon> GitHub Copilot</h2>
<p>GitHub Copilot is an AI-powered code completion tool that helps you write code faster and with fewer errors. It is based on the OpenAI Codex model and is available as a plugin for Visual Studio Code and other popular code editors. GitHub Copilot can generate code snippets, complete function calls, and provide context-aware suggestions to improve your coding experience.</p>
</section>
<section id="continue.dev-vscode-plugin" class="level2">
<h2 class="anchored" data-anchor-id="continue.dev-vscode-plugin">Continue.dev VSCode Plugin</h2>
<h2 class="anchored" data-anchor-id="continue.dev-vscode-plugin"><img src="../media/continue-logo.png" style="height:1em"> Continue.dev VSCode Plugin</h2>
<p><a href="https://docs.continue.dev/intro">Continue</a> is an open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside <a href="../development/ides.html#visual-studio-code">VS Code</a> and JetBrains.</p>


Expand Down
138 changes: 62 additions & 76 deletions ai/index.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -80,9 +80,9 @@
}

const options = {
valueNames: ['listing-date','listing-title','listing-author','listing-subtitle','listing-image','listing-description',{ data: ['index'] },{ data: ['categories'] },{ data: ['listing-date-sort'] },{ data: ['listing-file-modified-sort'] }],
valueNames: ['listing-title','listing-author','listing-image','listing-description',{ data: ['index'] },{ data: ['categories'] },{ data: ['listing-date-sort'] },{ data: ['listing-file-modified-sort'] }],

searchColumns: ["listing-date","listing-title","listing-author","listing-subtitle","listing-image","listing-description"],
searchColumns: ["listing-title","listing-author","listing-image","listing-description"],
};

window['quarto-listings'] = window['quarto-listings'] || {};
Expand Down Expand Up @@ -236,109 +236,95 @@ <h1 class="title"><iconify-icon inline="" icon="hugeicons:artificial-intelligenc
<section id="introduction" class="level2">
<h2 class="anchored" data-anchor-id="introduction">Introduction</h2>
<p>Artificial intelligence (AI) is a branch of computer science that aims to create intelligent machines that can simulate human cognitive processes. These machines are designed to perform tasks that typically require human intelligence, such as visual perception, speech recognition, decision-making, and language translation. AI technologies have the potential to revolutionize industries, improve efficiency, and enhance human capabilities in various domains.</p>
<div id="listing-ai-introduction" class="quarto-listing quarto-listing-container-default">
<div class="list quarto-listing-default">
<div class="quarto-post image-right" data-index="0" data-listing-date-sort="1720497600000" data-listing-file-modified-sort="1722523324337" data-listing-date-modified-sort="NaN" data-listing-reading-time-sort="2" data-listing-word-count-sort="363">
<div class="thumbnail">
<p><a href="../ai/llm-proxy.html" class="no-external"></a></p><a href="../ai/llm-proxy.html" class="no-external">
<div class="listing-item-img-placeholder card-img-top" >&nbsp;</div>
</a><p><a href="../ai/llm-proxy.html" class="no-external"></a></p>
<div id="listing-ai-introduction" class="quarto-listing quarto-listing-container-grid">
<div class="list grid quarto-listing-cols-3">
<div class="g-col-1" data-index="0" data-listing-file-modified-sort="1722555822538" data-listing-reading-time-sort="2" data-listing-word-count-sort="370">
<a href="../ai/llm-proxy.html" class="quarto-grid-link">
<div class="quarto-grid-item card h-100 card-left">
<p class="card-img-top">
<img loading="lazy" src="../media/litellm-logo.avif" class="thumbnail-image card-img" style="height: 150px;">
</p>
<div class="card-body post-contents">
<h5 class="no-anchor card-title listing-title">
🚅 LiteLLM Proxy
</h5>
<div class="card-text listing-description">
Access a variety of language models through a single endpoint using the LiteLLM Proxy.
</div>
<div class="body">
<h3 class="no-anchor listing-title">
<a href="../ai/llm-proxy.html" class="no-external">LiteLLM Proxy</a>
</h3>
<div class="listing-subtitle">
<a href="../ai/llm-proxy.html" class="no-external"></a>
<div class="card-attribution card-text-small start">
<div class="listing-author">

</div>
<div class="listing-description">
<a href="../ai/llm-proxy.html" class="no-external">The LiteLLM Proxy is a service that allows you to access a variety of language models (LLMs) through a single endpoint. This makes it easy to switch between different models…</a>
</div>
</div>
<div class="metadata">
<a href="../ai/llm-proxy.html" class="no-external">
<div class="listing-date">
Jul 9, 2024
</div>
</a>
</div>
<div class="g-col-1" data-index="1" data-listing-file-modified-sort="1722553713778" data-listing-reading-time-sort="1" data-listing-word-count-sort="148">
<a href="../ai/langfuse.html" class="quarto-grid-link">
<div class="quarto-grid-item card h-100 card-left">
<p class="card-img-top">
<img loading="lazy" src="../media/langfuse/langfuse-logo.png" class="thumbnail-image card-img" style="height: 150px;">
</p>
<div class="card-body post-contents">
<h5 class="no-anchor card-title listing-title">
Langfuse
</h5>
<div class="card-text listing-description">
ToxPipe Langfuse Dashboard
</div>
<div class="quarto-post image-right" data-index="1" data-listing-date-sort="1721966400000" data-listing-file-modified-sort="1722523768499" data-listing-date-modified-sort="NaN" data-listing-reading-time-sort="1" data-listing-word-count-sort="148">
<div class="thumbnail">
<p><a href="../ai/langfuse.html" class="no-external"></a></p><a href="../ai/langfuse.html" class="no-external">
<p><img loading="lazy" src="../media/langfuse/langfuse-logo.png" class="thumbnail-image"></p>
</a><p><a href="../ai/langfuse.html" class="no-external"></a></p>
</div>
<div class="body">
<h3 class="no-anchor listing-title">
<a href="../ai/langfuse.html" class="no-external">Langfuse</a>
</h3>
<div class="listing-subtitle">
<a href="../ai/langfuse.html" class="no-external">LLM Tracing</a>
<div class="card-attribution card-text-small start">
<div class="listing-author">

</div>
<div class="listing-description">
<a href="../ai/langfuse.html" class="no-external">ToxPipe Langfuse Dashboard</a>
</div>
</div>
<div class="metadata">
<a href="../ai/langfuse.html" class="no-external">
<div class="listing-date">
Jul 26, 2024
</div>
</a>
</div>
<div class="g-col-1" data-index="2" data-listing-file-modified-sort="1722544407570" data-listing-reading-time-sort="1" data-listing-word-count-sort="148">
<a href="../ai/coding-assistants.html" class="quarto-grid-link">
<div class="quarto-grid-item card h-100 card-left">
<p class="card-img-top"><img src="../media/continue-logo.png" style="height: 150px;" class="thumbnail-image card-img"/></p>
<div class="card-body post-contents">
<h5 class="no-anchor card-title listing-title">
Coding Assistants
</h5>
<div class="card-text listing-description">
Welcome to the NIEHS Coding Assistants Guide.
</div>
<div class="quarto-post image-right" data-index="2" data-listing-date-sort="1722052800000" data-listing-file-modified-sort="1722523324336" data-listing-date-modified-sort="NaN" data-listing-reading-time-sort="1" data-listing-word-count-sort="142">
<div class="thumbnail">
<p><a href="../ai/coding-assistants.html" class="no-external"></a></p><a href="../ai/coding-assistants.html" class="no-external">
<div class="listing-item-img-placeholder card-img-top" >&nbsp;</div>
</a><p><a href="../ai/coding-assistants.html" class="no-external"></a></p>
</div>
<div class="body">
<h3 class="no-anchor listing-title">
<a href="../ai/coding-assistants.html" class="no-external">Coding Assistants</a>
</h3>
<div class="listing-subtitle">
<a href="../ai/coding-assistants.html" class="no-external"></a>
<div class="card-attribution card-text-small start">
<div class="listing-author">

</div>
<div class="listing-description">
<a href="../ai/coding-assistants.html" class="no-external">Welcome to the NIEHS Coding Assistants Guide.</a>
</div>
</div>
<div class="metadata">
<a href="../ai/coding-assistants.html" class="no-external">
<div class="listing-date">
Jul 27, 2024
</div>
</a>
</div>
<div class="g-col-1" data-index="3" data-listing-file-modified-sort="1722544571693" data-listing-reading-time-sort="1" data-listing-word-count-sort="118">
<a href="../ai/automated-llm-evaluation.html" class="quarto-grid-link">
<div class="quarto-grid-item card h-100 card-left">
<p class="card-img-top">
<img loading="lazy" src="../media/promptfoo-logo.svg" class="thumbnail-image card-img" style="height: 150px;">
</p>
<div class="card-body post-contents">
<h5 class="no-anchor card-title listing-title">
Automated LLM Evaluation
</h5>
<div class="card-text listing-description">
Running automated large language model (LLM) testing using Promptfoo.
</div>
<div class="quarto-post image-right" data-index="3" data-listing-date-sort="1720497600000" data-listing-file-modified-sort="1722523324335" data-listing-date-modified-sort="NaN" data-listing-reading-time-sort="1" data-listing-word-count-sort="118">
<div class="thumbnail">
<p><a href="../ai/automated-llm-evaluation.html" class="no-external"></a></p><a href="../ai/automated-llm-evaluation.html" class="no-external">
<div class="listing-item-img-placeholder card-img-top" >&nbsp;</div>
</a><p><a href="../ai/automated-llm-evaluation.html" class="no-external"></a></p>
</div>
<div class="body">
<h3 class="no-anchor listing-title">
<a href="../ai/automated-llm-evaluation.html" class="no-external">Automated LLM Evaluation</a>
</h3>
<div class="listing-subtitle">
<a href="../ai/automated-llm-evaluation.html" class="no-external"></a>
<div class="card-attribution card-text-small start">
<div class="listing-author">

</div>
<div class="listing-description">
<a href="../ai/automated-llm-evaluation.html" class="no-external">This page shows how to run automated LLM testing. If you are part of the NIEHS Github organization, you can see an example of this in the NIEHS/ToxPipe-Model-Comparisons…</a>
</div>
</div>
<div class="metadata">
<a href="../ai/automated-llm-evaluation.html" class="no-external">
<div class="listing-date">
Jul 9, 2024
</div>
</a>
</div>
</div>
</div>
<div class="listing-no-matching d-none">
No matching items
</div>
Expand Down
7 changes: 3 additions & 4 deletions ai/langfuse.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,6 @@

<meta name="viewport" content="width=device-width, initial-scale=1.0, user-scalable=yes">

<meta name="dcterms.date" content="2024-07-26">

<title>Langfuse – NIEHS Scientific Developers Guide</title>
<style>
Expand Down Expand Up @@ -166,13 +165,13 @@ <h1 class="title">Langfuse</h1>
<div class="quarto-title-meta">



<div>
<div class="quarto-title-meta-heading">Published</div>
<div class="quarto-title-meta-heading">Modified</div>
<div class="quarto-title-meta-contents">
<p class="date">July 26, 2024</p>
<p class="date-modified">July 26, 2024</p>
</div>
</div>


</div>

Expand Down
Loading

0 comments on commit 39a52f9

Please sign in to comment.