Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

chenlongzhen/django-SearchEngine-bert

Repository files navigation

basic search engine based on bert-model and django

  1. 搜索补全
  2. 精确和模糊匹配
  3. bert模型召回

usage

evironment

python 3.6 tensorflow=1.10.0

conda create -n py3 python=3.6
pip install -r requirements.txt
conda install annoy
conda install -c aaronzs tensorflow
pip install bert-serving-server # server
pip install bert-serving-client # client, independent of `bert-serving-server`

start bert service

download chinese_L-12_H-768_A-12 unzip to ./bert/

conda activate py3
# bert server
echo "启动bertservice..."
nohup bert-serving-start -model_dir ./bert/chinese_L-12_H-768_A-12/ -num_worker=1 -port=4000 -port_out=4001 > bert_server.log &
tail -f bert_server.log

start web

conda activate py3
python manage.py makemigrations 
python manage.py migrate
python manage.py runserver 0.0.0.0:8000

upload search data

  • data file should be in csv type, has two rows, key and value
  • key is used to autocomplete
  • value is used to get result by search key

like this:

upload website: http://127.0.0.1:8000/upload/

main page:

http://127.0.0.1:8000/search_cxbc

About

basic search engine based on bert-model and django

Topics

Resources

Stars

Watchers

Forks

Packages

No packages published

Languages

AltStyle によって変換されたページ (->オリジナル) /