Skip to content

Commit

Permalink
use mkdocs to generate documentation (#1070)
Browse files Browse the repository at this point in the history
  • Loading branch information
lvyufeng authored May 13, 2024
1 parent e0ebe50 commit 2a4e534
Show file tree
Hide file tree
Showing 122 changed files with 326 additions and 11,851 deletions.
3 changes: 2 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -156,4 +156,5 @@ RuntimeProfiler*
checkpoint-*/
data*/
!mindnlp/data/
!mindnlp/dataset/
!mindnlp/dataset/
!docs/api/data/
22 changes: 6 additions & 16 deletions .readthedocs.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,4 @@
# .readthedocs.yaml
# Read the Docs configuration file
# Read the Docs configuration file for MkDocs projects
# See https://docs.readthedocs.io/en/stable/config-file/v2.html for details

# Required
Expand All @@ -9,21 +8,12 @@ version: 2
build:
os: ubuntu-22.04
tools:
python: "3.7"
# You can also specify other tool versions:
# nodejs: "19"
# rust: "1.64"
# golang: "1.19"
python: "3.12"

# Build documentation in the docs/ directory with Sphinx
sphinx:
configuration: docs/conf.py
mkdocs:
configuration: mkdocs.yml

# If using Sphinx, optionally build your docs in additional formats such as PDF
# formats:
# - pdf

# Optionally declare the Python requirements required to build your docs.
# Optionally declare the Python requirements required to build your docs
python:
install:
- requirements: requirements/docs_requirements.txt
- requirements: requirements/docs_requirements.txt
21 changes: 5 additions & 16 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,19 +18,16 @@
</a>
</p>

[Installation](#installation) |
[Introduction](#introduction) |
[Quick Links](#quick-links) |

### News 📢

* 🔥 **Latest Features**

* 🤗 Hugging *huggingface* ecosystem, we use **datasets** lib as default dataset loader to support
mounts of useful datasets.
* 📝 MindNLP supports NLP tasks such as *language model*, *machine translation*, *question answering*, *sentiment analysis*, *sequence labeling*, *summarization*, etc. You can access them through [examples](./examples/).
* 🚀 MindNLP currently supports industry-leading Large Language Models (LLMs), including **Llama**, **GLM**, **RWKV**, etc. For support related to large language models, including ***pre-training***, ***fine-tuning***, and **inference** demo examples, you can find them in the ["llm" directory](./llm/).
* 🤗 Pretrained models support ***huggingface transformers-like apis***, including **60+** models like **[BERT](./mindnlp/transformers/models/bert)**, **[Roberta](./mindnlp/transformers/models/roberta)**, **[GPT2](./mindnlp/transformers/models/gpt2)**, **[T5](./mindnlp/transformers/models/t5)**, etc.
* 📝 MindNLP supports NLP tasks such as *language model*, *machine translation*, *question answering*, *sentiment analysis*, *sequence labeling*, *summarization*, etc. You can access them through [examples](https://github.com/mindspore-lab/mindnlp/examples/).
* 🚀 MindNLP currently supports industry-leading Large Language Models (LLMs), including **Llama**, **GLM**, **RWKV**, etc. For support related to large language models, including ***pre-training***, ***fine-tuning***, and **inference** demo examples, you can find them in the ["llm" directory](https://github.com/mindspore-lab/mindnlp/llm/).
* 🤗 Pretrained models support ***huggingface transformers-like apis***, including **60+** models like **[BERT](https://github.com/mindspore-lab/mindnlp/mindnlp/transformers/models/bert)**, **[Roberta](https://github.com/mindspore-lab/mindnlp/mindnlp/transformers/models/roberta)**, **[GPT2](https://github.com/mindspore-lab/mindnlp/mindnlp/transformers/models/gpt2)**, **[T5](https://github.com/mindspore-lab/mindnlp/mindnlp/transformers/models/t5)**, etc.
You can use them easily by following code snippet:
```python
from mindnlp.transformers import AutoModel
Expand Down Expand Up @@ -84,18 +81,10 @@ The master branch works with **MindSpore master**.
- **Friendly NLP model toolset**: MindNLP provides various configurable components. It is friendly to customize models using MindNLP.
- **Easy-to-use engine**: MindNLP simplified complicated training process in MindSpore. It supports Trainer and Evaluator interfaces to train and evaluate models easily.

### Quick Links

- [Documentation](https://mindnlp.cqu.ai/en/latest/)
- [Tutorials](./tutorials/)
- [Examples](./examples)
- [LLMs](./llm)
- ...


### Supported models

Since there are too many supported models, please check [here](./SUPPORT_MODEL.md)
Since there are too many supported models, please check [here](https://mindnlp.cqu.ai/supported_models)

<!-- ## Tutorials
Expand Down Expand Up @@ -124,7 +113,7 @@ If you find this project useful in your research, please consider citing:

```latex
@misc{mindnlp2022,
title={{MindNLP}: a MindSpore NLP library},
title={{MindNLP}: Easy-to-use and high-performance NLP and LLM framework based on MindSpore},
author={MindNLP Contributors},
howpublished = {\url{https://github.com/mindlab-ai/mindnlp}},
year={2022}
Expand Down
20 changes: 0 additions & 20 deletions docs/Makefile

This file was deleted.

43 changes: 0 additions & 43 deletions docs/api/abc.rst

This file was deleted.

13 changes: 0 additions & 13 deletions docs/api/dataset.rst

This file was deleted.

35 changes: 0 additions & 35 deletions docs/api/dataset/hf_datasets.rst

This file was deleted.

29 changes: 0 additions & 29 deletions docs/api/dataset/machine_translation.rst

This file was deleted.

21 changes: 0 additions & 21 deletions docs/api/dataset/question_answer.rst

This file was deleted.

13 changes: 0 additions & 13 deletions docs/api/dataset/registered.rst

This file was deleted.

21 changes: 0 additions & 21 deletions docs/api/dataset/sequence_tagging.rst

This file was deleted.

Loading

0 comments on commit 2a4e534

Please sign in to comment.